In the golden age of digital tools, AI is marketed as a superpower, a personal assistant, a creative co-pilot, and a way to unlock productivity at scale. But as platforms evolve, AI stops being a feature and becomes the framework; a subtle shift is happening: you’re no longer just the user but the training data.
Take Grok, the AI now bundled into X. On paper, it’s a perk: X Premium members get exclusive access to Grok, positioned as a smart, context-aware chatbot with a dash of sarcasm and a lens on breaking news. But peel back the sleek interface, and a larger truth emerges: Grok isn’t just working for you; it’s learning from you. Constantly. Silently. Automatically.
The Behavior Behind the Bot
Grok is developed by xAI, Elon Musk’s AI venture. It’s not a separate app. It doesn’t live in a vacuum. It’s baked into X, a platform where your thoughts, likes, follows, reposts, and search patterns aren’t just features of your feed; they’re a goldmine of behavioral insight.
According to the xAI Terms of Service and Privacy Policy, Grok can access information like your X handle, profile picture, and subscription status by linking your account. But that’s the surface. What’s more telling is what’s not explicitly said: that every interaction on X potentially feeds into the AI’s understanding of culture, language, and sentiment, including yours.
You don’t need to open Grok. You just need to be on the platform.
Opted-In By Default
Unlike standalone tools like ChatGPT, where users consciously decide to opt in, engage, and share data with clarity, Grok’s integration into X Premium flips the model. By paying for the platform, you also pay to grant it deeper access to who you are online.
Users are not given the option that says, “Don’t use my behavior to train Grok.” There is no setting to prevent the AI from learning the tone of your tweets or the types of media you consume. In this new bundled AI model, your behavior is the prompt.
Once that behavior is absorbed into the neural net, it can’t be taken back.
The Line Between Personalization and Profiling
Here’s where it gets murky. Yes, context-aware AI can be powerful. Grok might tailor its answers to trending topics or regional slang because it understands the X ecosystem in real-time. That’s not inherently bad. But the dynamic changes when the personalization is trained on you without clarity, control, or consent.
This isn’t personalization anymore. It’s profiling. And that profiling doesn’t just enhance the product but makes you part of the product.
Surveillance Disguised as Service
The quiet cost of bundled AI isn’t the subscription fee. It’s the erosion of digital agency. You’re paying for an ecosystem that studies your behavior as much as it serves your needs. And because AI thrives on scale, nuance, and real-time human expression, platforms like X are becoming fertile training grounds where every emoji, repost, or hot take becomes a data point.
When AI is deeply embedded in your platform experience, and the platform doesn’t let you choose whether or not you participate, that’s not a feature; it’s surveillance disguised as a service.
Ask the Hard Question
The central question is simple but profound:
Are you still the customer, or are you now the unpaid prompt powering the product?
As AI continues to blur the line between utility and intrusion, bundled ecosystems like X + Grok remind us that the most valuable currency in tech isn’t money but behavior. And unless we demand transparency and choice, we’ll keep feeding systems that know everything about us… without us knowing what they know.
Author’s Note:
We need a future where AI is opt-in, not absorbed. Where personalization isn’t profiling and where tech platforms respect the difference between training on data and training on people. Until then, remember: when AI is always on, you are always the prompt.
