Sovereign Clouds and Sovereign AI

Sovereign Clouds and Sovereign AI

The concept of sovereign AI is gaining traction. It refers to artificial intelligence systems that are designed, deployed, and managed within the borders and legal frameworks of a specific nation or region. As the global reliance on AI intensifies, the necessity to establish control over these powerful systems has become of importance for governments, businesses, and citizens alike. The rise of sovereign AI is not only a technological shift – it is a rethinking of data sovereignty, privacy, and national security. 

Data Sovereignity

Sovereign AI offers a solution by ensuring that data, AI models, and the insights derived from them remain within the jurisdiction of the entity that owns them. This is particularly critical for industries such as finance, healthcare, defense, and public administration, where data is not only sensitive but also strategically important.

However, achieving data sovereignty is not without challenges. Traditional cloud and data management systems often involve storing and processing data across multiple jurisdictions, making it difficult to ensure compliance with local laws. We need to ensure that data remains within a specific legal framework, while still benefiting from the scalability, performance, and flexibility of cloud-based solutions.

Building the Infrastructure for Sovereign AI

Does sovereign AI imply that enterprises and national clouds need to be truly “sovereign”? I am not so sure about that, but the underlying infrastructure must be robust, secure, and compliant with local regulations. IT teams and CIOs need to think about the deployment of cloud and data management solutions that are tailored to the needs of specific regions, ensuring data sovereignty is maintained without sacrificing the benefits of cloud computing:

  • Localized Cloud Infrastructure: Think about an infrastructure that ensures data does not leave the country’s borders. Different private data centers in different regions must offer the same level of performance, security, and availability.
  • Data Security: Here we talk about end-to-end encryption, access controls, and continuous monitoring to prevent unauthorized access.
  • Compliance: Infrastructure must be built with compliance in mind, which means adhering to local laws or regulations regarding data protections, privacy, and AI ethics.
  • Interoperability and Integration: The goal here is to achieve a balance between control and an adaptable cloud infrastructure.

Use AI to provide Artificial Intelligence

What happened to compute, storage, and networking is happening with data (management) as well. We see different vendors enhancing their platform and database offerings with artificial intelligence. The basic idea is to use AI and machine learning to provide automation, which increases speed and security.

Think about self-optimizing intelligence-driven databases and systems that use AI to monitor performance, identify bottlenecks, and make adjustments without human intervention, ensuring that data is always available and secure. Systems and DBs that automatically detect and respond to threats based on anomaly detection. 

Balancing Innovation with Responsibility

One of the key challenges of sovereign AI is finding the right balance between innovation and responsibility (not only regulation). While it is important to protect data and ensure compliance with local laws, it is also essential that AI systems remain sustainable, innovative and able to leverage global advancements. 

Large Language Models (LLMs) have become a cornerstone of modern AI, enabling machines to generate human-like text, understand natural language, and perform a wide array of tasks from translation to summarization. These models, built on huge datasets and advanced neural architectures, represent a significant leap in AI capabilities. However, the creation and deployment of LLMs come with substantial costs in terms of time, financial investment, and environmental impact.

Green AI initiatives are one promising approach, focusing on reducing the environmental impact of AI development by using renewable energy sources, designing energy-efficient infrastructures, and promoting transparency around the energy consumption and carbon footprint of AI models. Collaboration and open research are also key, allowing the AI community to share resources, reduce duplication of effort, and accelerate the development of more efficient and sustainable models.

Conclusion

Recent trends indicate a growing emphasis on localized cloud infrastructure, where providers are building new data centers within national borders to comply with data sovereignty laws. This trend is driven by a combination of factors, including the rise of GDPR-like regulations and growing concerns over foreign surveillance and cyber threats. Additionally, the Digital Operational Resilience Act (DORA), introduced by the European Union, emphasizes the need for robust digital infrastructure resilience, pushing organizations to adopt sovereign cloud solutions that can guarantee operational continuity while adhering to regulatory requirements. This involves not only the localized deployment of AI models but also the creation of AI governance frameworks that ensure transparency, accountability, and fairness.

The integration of sovereign cloud and sovereign AI will likely become a standard practice for public sector organizations and industries dealing with sensitive data. The latest advancements in edge computing, federated learning, and secure multi-party computation are further enabling this shift, allowing AI systems to process data locally while maintaining global collaboration and innovation.

Navigating the AI Buffet – Strategies and Metrics for Successful Enterprise Implementations

Navigating the AI Buffet – Strategies and Metrics for Successful Enterprise Implementations

Artificial intelligence (AI) is gaining momentum everywhere. We see new solutions, partnerships and even reference architectures popping up almost daily. Additionally, organizations, lawyers and country leaders are looking for the right balance between business value and compliance needs. Without going too much into details, I said to myself, that artificial intelligence has e lot in common with cloud computing and multi-clouds. Just because it is out there everywhere, does it mean we should / are allowed to use it? Organizations are going to use both public and private clouds to host their non-AI and AI workloads, but what is their strategy? How do enterprises implement and successfully manage AI-based technologies and processes in order to generate a sustainable strategy and long-term competitive advantages?

What I won’t do

So, I asked myself: What is my role in this whole (crazy) AI world? What do I need to know? What do I have to do?

First, let me tell you what I won’t or cannot do:

  • I do not have 4+ years of experience working with machine learning
  • I have no competencies to write ML code using TensorFlow, PyTorch or Keras
  • Python? No, no experience, sorry
  • I do not do data engineering as well
  • I understand storage and compute, yes, but no clue when it comes to correlating models with parameter and data
  • No, I don’t have real knowledge of Large Language Models (LLM) or HuggingFace models
  • I do not understand a full MLOps technical stack
  • I cannot fine-tune or tweak AI models
  • No, I don’t fully understand the possibilities of confidential computing or confidential AI

All the things above? That is not me.

What are my questions?

I think most of us start at the same place. First, when this hype started, we had to figure out what AI really means, where it is coming from and what types of AI exist.

After that, how did you continue? Probably like me and many others, you tried out ChatGPT, read about LLMs and generative AI (genAI). Eventually, you also tried out new plugins or tools to enhance your productivity.

A few months ago, I had a short conversation with a CTO from a large bank. A really large bank.

Guess what? He could not tell me how they move forward with the topic “artificial intelligence”. They have not figured out or decided yet what to do in terms of data privacy and control.

Decision-Makers and Data Scientists

This conversation led me to two important questions, and I believe this is what I want to do in the next few months and coming years:

  1. What does it take to implement AI in organizations?
  2. How can the success of an AI strategy and implementation be measured?

These are the topics I want to specialize in. This is the homework I and many others need to do first. These are the conversations I want to have with my customers first before we talk about infrastructure, data, and reference architectures.

My focus

I would like to get a better understanding of how organizations plan to get value with artificial intelligence. It is important, like we had to learn with cloud computing and hybrid or multi-cloud architecture over the past decade or so, to get a complete view and understanding of the opportunities and risks, as well as an understanding of the financial and organizational resources an enterprise might need.

What are the business models and frameworks one has to implement? What is a “good” strategy and how do you manage and measure that? What are the KPIs? What about feasibility and cost-effectiveness?

I want to understand the best practices and how some decision-makers have implemented a successful long-term strategy including processes, culture and technology.

I recently learned that artificial intelligence and machine learning implementations require a huge software stack. Do we really need to understand all the options and the solutions from different vendors? If not, who has got this knowledge? Data scientists?

Conclusion

In conclusion, the journey of implementing artificial intelligence in enterprises mirrors the experience of navigating an all-you-can-eat buffet.

I (still) have so many questions. My mission is to find answers and opinions to these questions, and I would not be surprised if it takes between 12 and 24 months.

The history of AI is more than 70 years old, but it seems we just have started now. While I understand that we live with AI every day now, I also want to understand how this field will develop and what is next. What are the trends?

As enterprises continue to embrace the AI buffet, it is not just about filling plates with technology. It is about crafting a menu that satisfies the hunger for innovation and excellence.

Note: The images for this article have been created with the help of artificial intelligence