Showing posts with label Gemini. Show all posts
Showing posts with label Gemini. Show all posts

1.11.26

AI News This Week (Oct 25–31): What Changed for VAs


AI news this week was mostly about your inbox, your calendar and your client's slide decks. Here are the updates from October 25 to 31 that change how a virtual assistant works, and one outage you should know about.

I've grouped them by the part of your day they touch, and every date comes from the company's own announcement.

Inbox and Calendar: ChatGPT Reaches Apple Users

On October 27, OpenAI added iCloud Mail and iCloud Calendar to ChatGPT. It can find emails, catch you up on your inbox, check your schedule and update events. OpenAI says it's available on all ChatGPT plans, on the web, the desktop app and iPhone.

This matters if you have a client who lives in Apple Mail instead of Gmail or Outlook.

Then on October 30, the ChatGPT phone app started letting you stay signed in to two accounts and switch between them. Each one keeps its own chats, memory and settings. If you use your own account plus a client's Business workspace, this keeps the two from mixing.

The Outage Nobody Talked About

Here's the story I found most useful, and it got almost no coverage. Claude's status page shows its Google Calendar connector (the link that lets Claude read your calendar) had errors from October 26 to October 28, about two and a third days. A separate Gmail connector problem lasted about six and a half hours on the evening of October 27, Pacific time.


Claude's status page showing the Google Calendar connector incident, October 26 to 28

So if Claude told you "there's nothing on the calendar Tuesday" during that window, check it again by hand. And if your whole inbox routine runs through an AI connector, keep a manual fallback for days like this.

Docs, Decks and Spreadsheets

On October 29, Google said the Gemini app can now preview and edit files right inside the chat: PDFs, Docs, Sheets, slide decks and plain text. Google says it's for all users wherever the Gemini app works. Making files in Gemini isn't new. Fixing them without copying everything into Docs first is.

Google Slides also got a bigger one. Gemini in Slides can now edit a whole deck from one request, like "make the titles on all slides the same font size and color." It's English only, on paid Workspace plans and Google AI Pro or Ultra, and Google says the rollout could take more than 15 days to reach you.

Two more for the design and data side. Canva launched Brush, a tool that edits an existing design from a prompt, for Canva Pro subscribers. And Microsoft's October Copilot roundup confirmed a "Clean data" skill in Excel that finds duplicates and messy formatting, then asks you to approve each fix. That one needs Microsoft 365 Copilot.

Team Chat and Meetings

Slack's Slackbot can now run a task on its own when something happens, like a new message or an emoji reaction. Think "every time a client posts in #requests, add it to my list." Slack says what you get depends on your plan and your admin, so ask before you count on it.

Notion said on X that its Meeting Notes extension for Google Meet now labels each speaker by name, instead of just "you" and "everyone else." That makes action items much easier to assign. Notion also says its Agent can now build Excel, Word, PowerPoint and PDF files for you.

New Models and Plan Changes

OpenAI released GPT-6.1 Terra on October 26. A model is the AI brain behind the chat, and OpenAI pitches this one for "computer use" (the AI clicking through apps for you) and "clear, natural writing." It's in ChatGPT Work and Codex for Plus, Pro, Business, Enterprise and Edu, and your usage limits stay the same.

On the Claude side, two quieter changes. On October 29, Haiku 4.5 left the model picker and anyone using it was moved to Haiku 5.5, so check any saved prompts you ran on it. And on October 30, Anthropic renamed its top plans: Max 5x is now Max ($100 a month) and Max 20x is now Ultra ($200). Verified Ultra accounts no longer have the five-hour limit. The weekly limit didn't change, despite what some posts say.

The Bigger Picture

Anthropic, the company behind Claude, made its IPO filing public on October 26, planning to list on Nasdaq as "ANT." You may have seen "$2 trillion IPO" headlines. The filing doesn't set a price or a valuation yet.

Closer to home, the Foundation for Media Alternatives published a Philippine AI risk report on October 30. Job loss and "labor intensification" (more work, faster, for the same pay) came out as the most widespread risks. The Philippines still has no AI law, and the report says seven House bills are being merged into one.

What This Means for VAs

Look at the pattern. Almost every update this week moves AI deeper into the tools we already manage for clients: mail, calendars, decks, Slack, meeting notes. That's good news for us, because someone still has to set these up, check the output and notice when a connector quietly breaks for two days.

That last part is the skill. The FMA report warns about "more work, same pay," and the way around it is to sell the judgment, not the hours. A VA who can say "I connected your calendar to AI, and I double-check it every morning" is offering something a tool can't.

My pick for this weekend: if you have an Apple-using client, test the ChatGPT iCloud connection on your own account first, then decide if it's safe for theirs.

Which of these updates are you trying first? 

26.10.26

Gmail AI Inbox: The Catch for VAs Managing Client Inboxes


Gmail AI Inbox is rolling out to paid Google Workspace accounts, and it turns a busy inbox into a to-do list. The catch for VAs: Google's help page says it doesn't support delegated inboxes, which is how a lot of us get into a client's email.

So here's what it does, who actually gets it, and how to make it useful for your client anyway.

What Gmail AI Inbox Does

Google announced the Workspace rollout on October 15, 2026. AI Inbox is a separate view in Gmail with two sections.

"Suggested to-dos" pulls action items, deliverables and deadlines out of email threads. Think "send the signed contract by Friday," lifted out of a long reply chain. "Topics to catch up on" gives short summaries of your most important threads, so you can see the latest decisions without reading 14 messages.

It's part of Gemini, Google's AI, so it's built into Gmail itself. Your client doesn't install anything.


Who Gets It (Read This Before You Promise Anything)

This is where I'd slow down before telling a client "you have this now."

It's only for users in the US with English (US) as their language. Google's list names Business and Enterprise (Starter, Standard and Plus), Frontline Plus and AI Pro for Education, but the same post says Starter and Education editions get it later, "in the coming months." So for now, count on Standard and Plus. Personal Google accounts need a Google AI Plus, Pro or Ultra plan.

There's no admin switch for it. It rolls out over up to 15 days: Rapid Release domains started October 12, and Scheduled Release domains start October 26. If your client's account is on Scheduled Release, it may show up any day in the next two weeks.


The Fine Print for VAs

Google's help page lists a few limits that matter if you manage someone else's email.

It reads only the Primary tab, not Social or Promotions. It skips anything archived, deleted, muted or snoozed. And it "does not support attachments, delegated inboxes, or encrypted emails." Delegated access is when your client lets you open their Gmail from your own account. If that's your setup, AI Inbox won't help you there.

It also needs Gmail's smart features turned on, and Google says your first to-dos can take up to 7 days to appear.

One more: the "Mark all as read" button in AI Inbox also marks those emails as read in the regular inbox. If your client relies on bold unread emails as their reminder system, don't click it on their behalf.

Gmail Live: The Voice Version

Google rolled out a second feature the same day, Gmail Live. On the Gmail phone app, you tap Live in the search bar and ask your inbox a question out loud, like "when is my next mandatory training due?" It answers by voice and shows a card with the source email every time, so you can check where the answer came from.

Same rule: US users with English (US) only. It's on by default for organizations with Gemini, across Business Starter, Standard and Plus, Enterprise plans, and Google's consumer AI Plus, Pro and Ultra plans.

What This Means for VAs

If your client is in the US on an eligible plan, their inbox is about to start writing its own to-do list. That's good news for you, not bad news.

Here's how I'd use it. Ask your client to open AI Inbox once a day and forward you anything in "Suggested to-dos" they want handled. You turn their list into action: the reply, the calendar block, the follow-up. Their AI spots the task, and you get it done.

If you work through delegated access, keep your own triage routine. AI Inbox won't see what you see, so your morning sort is still the one your client can trust.

And if your client is outside the US, or on Business Starter, you have time. Learn how it works now so you're the one explaining it when it arrives.

Want more updates like this one, translated for VAs? 

12.3.26

Google Just Replaced Five AI Search Tools With One

Have you ever tried searching through a client’s content library where videos are in one folder, PDFs in another, and audio recordings scattered everywhere?

That’s the reality for most content libraries.

Until now, AI search tools struggled with this kind of setup because each type of content needed a different system to process it.

But that may be changing.

Gemini Embedding 2 — recently released by Google — can search across text, images, audio, video, and PDFs at the same time, without converting everything first.

For anyone managing knowledge bases, course content, research archives, or client media libraries, this could be a major shift.


What an Embedding Model Actually Does

Before explaining why this matters, it helps to understand what an embedding model is.

When AI systems search through content, they don’t read information the same way humans do. Instead, they convert content into numerical representations that capture meaning.

For example:

  • A sentence about a cat

  • A photo of a cat

Both produce similar number patterns, which allows the AI to recognize that they are related.

That’s how modern AI-powered search works.

The tool responsible for converting content into these numerical representations is called an embedding model.


The Problem With Older AI Search Systems

Until recently, every type of content required a different embedding system.

Typical setups looked like this:

  • Text → processed by a text embedding model

  • Images → processed by image models such as CLIP or SigLIP

  • Audio → first transcribed using systems like Whisper

  • Video → broken into frames or transcripts

  • PDFs → converted into plain text

This created several issues:

  • Multiple models to manage

  • Several conversion steps

  • More chances for things to break

  • Slower search performance

In many cases, five different pipelines were required just to search one content library.


What Gemini Embedding 2 Changes

Gemini Embedding 2 solves this by creating one shared search space for multiple content types.

Instead of converting everything separately, the model processes different media formats directly and places them into the same semantic search system.

That means a single query can return results from:

  • Documents

  • Images

  • Audio clips

  • Video files

  • PDFs

All at once.

For example, you could:

  • Upload a photo and find related videos

  • Submit a voice recording and find matching documents

  • Search inside PDF files without converting them


Supported Input Types

Gemini Embedding 2 currently supports multiple media types in one system:

Text
Up to roughly 8,000 words

Images
Up to six images in one request

Audio
Raw audio files — no transcription required

Video
Clips up to two minutes long

PDFs
Original files can be processed without converting to plain text

All of this works through one model instead of multiple specialized ones.


Combining Multiple Inputs in One Search

One interesting feature is the ability to combine different types of input into a single query.

For example, you might have:

  • A photo of a product

  • A text description of what you want

Both can be submitted together, and the system generates one combined embedding representing the meaning of both inputs.

This allows searches that were previously impossible using single-modality tools.


Easy Integration for Developers

Another surprising detail is how quickly developers can start using it.

Gemini Embedding 2 launched with support for popular AI development frameworks, including:

  • LangChain

  • LlamaIndex

  • ChromaDB

  • QDrant

Because many AI applications are already built on these frameworks, developers can integrate the model without building a new infrastructure from scratch.

It’s available through:

  • Google AI Studio (free tier for experimentation)

  • Vertex AI (enterprise deployment)


Why This Matters for Virtual Assistants and Content Managers

Think about the kinds of content many clients manage.

A podcast brand might have:

  • Audio episodes

  • Show notes

  • PDFs

  • Promotional images

A course creator may have:

  • Video lessons

  • Slide decks

  • Written summaries

A consultant might maintain:

  • Recorded calls

  • Presentations

  • Research reports

Searching across all of that in a single step has been extremely difficult.

With models like Gemini Embedding 2, developers can build search tools where one query instantly returns:

  • the right video segment

  • the correct slide

  • the relevant document section

All from one search bar.


The Bigger Picture

You probably won’t interact with Gemini Embedding 2 directly.

Instead, it will power the next generation of search tools used in:

  • knowledge management systems

  • research databases

  • course platforms

  • internal company search tools

But knowing that technology like this exists helps you understand what’s becoming possible.

That knowledge can make a big difference when clients start asking about AI-powered search, automation, or content organization systems.


If you manage content libraries, research archives, or client knowledge bases, this is a technology worth paying attention to.

The tools many teams will rely on in the near future are already being built on models like this. 

15.8.25

Oracle Will Offer Google’s Gemini Models via OCI—A Pragmatic Shortcut to Agentic AI at Enterprise Scale

Oracle and Google Cloud have expanded their partnership so Oracle customers can tap Google’s latest Gemini family directly from Oracle Cloud Infrastructure (OCI) and across Oracle’s business applications. Announced on August 14, 2025, the deal aims squarely at “agentic AI” use cases—bringing planning, tool use, and multimodal generation into day-to-day enterprise workflows. 

What’s new: Oracle says it will make “the entire range” of Google’s Gemini models available through OCI Generative AI, via new integrations with Vertex AI. That includes models specialized for text, image, video, speech and even music generation, with the initial rollout starting from Gemini 2.5. In other words, teams can compose end-to-end agents—retrieve data, reason over it, and produce rich outputs—without leaving Oracle’s cloud. 

Enterprise reach matters here. Beyond developer access in OCI, Oracle notes that customers of its finance, HR, and supply-chain applications will be able to infuse Gemini capabilities into daily processes—think automated close packages, job-description drafting, supplier-risk summaries, or multimodal incident explainers. The practical promise: fewer swivel-chair handoffs between tools and more AI-assisted outcomes where people already work. 

Buying and operating model: Reuters reports customers will be able to pay for Google’s AI tools using Oracle’s cloud credit system, preserving existing procurement and cost controls. That seemingly small detail removes a classic blocker (separate contracts and billing) and makes experimentation less painful for IT and finance. 

Why this partnership, and why now?

• For Oracle, it broadens choice. OCI already aggregates multiple model providers; adding Gemini gives customers a top-tier, multimodal option for agentic patterns without forcing a provider switch.
• For Google Cloud, it’s distribution. Gemini lands in front of Oracle’s substantial enterprise base, expanding Google’s AI footprint in accounts where the “system of record” lives in Oracle apps. 

What you can build first

  • Multimodal service agents: ingest PDFs, images, and call transcripts from Oracle apps; draft actions and escalate with verifiable citations.
  • Supply-chain copilots: analyze shipments, supplier news, and inventory images; generate risk memos with recommended mitigations.
  • Finance and HR automations: summarize ledger anomalies, produce policy-compliant narratives, or generate job postings with skills mapping—then loop a human approver before commit. (All of these benefit from Gemini’s text, image, audio/video understanding and generation.) 

How it fits technically

The integration path leverages Vertex AI on Google Cloud as the model layer, surfaced to OCI Generative AI so Oracle developers and admins keep a single operational pane—policies, observability, and quotas—while calling Gemini under the hood. Expect standard SDK patterns, prompt templates, and agent frameworks to be published as the rollout matures. 

Caveats and open questions

Availability timing by region, specific pricing tiers, and which Gemini variants (e.g., long-context or domain-tuned models) will be enabled first weren’t fully detailed in the initial announcements. Regulated industries will also look for guidance on data residency and cross-cloud traffic flows as deployments move from pilots to production. For now, the “pay with Oracle credits” and “build inside OCI” signals are strong green lights for proofs of concept. 

The takeaway

By making Google’s Gemini models first-class citizens in OCI and Oracle’s application stack, both companies reduce friction for enterprises that want agentic AI without a multi-vendor integration slog. If your roadmap calls for multimodal assistants embedded in finance, HR, and supply chain—or developer teams building agents against Oracle data—this partnership lowers the barrier to getting real value fast. 

12.8.25

From Jagged Intelligence to World Models: Demis Hassabis’ Case for an “Omni Model” (and Why Evals Must Grow Up)

 DeepMind’s cadence right now is wild—new drops practically daily. In this conversation, Demis Hassabis connects the dots: “thinking” models (Deep Think), world models that capture physics, and a path toward an omni model that unifies language, vision, audio, and interactive behavior. As an AI practitioner, I buy the core thesis: pure next-token prediction has hit diminishing returns; reasoning, tool-use, and grounded physical understanding are the new scaling dimensions.

I especially agree with the framing of thinking as planning—AlphaGo/AlphaZero DNA brought into the LLM era. The key is not the longest chain of thought, but the right amount of thought: parallel plans, prune, decide, iterate. That’s how strong engineers work, and it’s how models should spend compute. My caveat: “thinking budgets” still pay a real latency/energy cost. Until tool calls and sandboxed execution are bulletproof, deep reasoning will remain spiky in production.

The world model agenda resonates. If you want robust robotics or assistants like Astra/Gemini Live, you need spatiotemporal understanding, not just good text priors. Genie 3 is a striking signal: it can generate coherent worlds where objects persist and physics behaves sensibly. I’m enthusiastic—and I still want tougher tests than “looks consistent.” Sim-to-real is notorious; we’ll need evaluations for controllable dynamics, invariances (occlusion, lighting, continuity), and goal-conditioned behavior before I call it solved.

Hassabis is refreshingly blunt about jagged intelligence. Yes, models ace IMO-style math yet bungle simple logic or even chess legality. Benchmarks saturate (AIME hitting ~99%); we need new stressors. I like Game Arena with Kaggle—self-advancing tournaments give clear, leak-resistant signals and scale with capability. Where I push back: games aren’t the world. Outside well-specified payoffs, reward specification gets messy. The next wave of evals should be multi-objective and long-horizon—measuring planning, memory, tool reliability, and safety traits (e.g., deception) under distribution shift, not just single-shot accuracy.

Another point I applaud: tools as a scaling axis. Let models reason with search, solvers, and domain AIs (AlphaFold-class tools) during planning. The open question—what becomes a built-in capability versus an external tool—is empirical. Coding/math often lifts general reasoning; chess may or may not. My hesitation: as “models become systems,” provenance and governance get harder. Developers will need traceable tool chains, permissions, and reproducible runs—otherwise we ship beautifully wrong answers faster.

Finally, the omni model vision—converging Genie, Veo, and Gemini—feels inevitable. I’m aligned on direction, wary on product surface area. When base models upgrade every few weeks, app teams must design for hot-swappable engines, stable APIs, and eval harnesses that survive version churn.

Net-net: I’m excited by DeepMind’s trajectory—reasoning + tools + world modeling is the right stack. But to turn wow-demos into trustworthy systems, we must grow our evaluations just as aggressively as our models. Give me benchmarks that span days, not prompts; measure alignment under ambiguity; and prove sim-to-real. Do that, and an omni model won’t just impress us—it’ll hold up in the messy, physical, human world it aims to serve.


31.7.25

LangExtract: Google’s Gemini-Powered Library That Turns Raw Text into Reliable Data

 

A new way to mine insight from messy text

On July 30 2025 the Google Developers Blog unveiled LangExtract, an open-source Python package that promises to “unlock the data within” any text-heavy corpus, from clinical notes to customer feedback threads. Built around Gemini models but compatible with any LLM, the project aims to replace brittle regex pipelines with a single declarative interface for extraction, visualization and traceability. 

Why LangExtract stands out

LangExtract combines seven features that rarely appear together in one tool:

  1. Precise source grounding – every entity you pull out is linked back to its exact character span in the original document, so auditors can see where a value came from.

  2. Schema-enforced outputs – you describe the JSON you want, add a few examples, and the library leverages Gemini’s controlled generation to keep responses on-spec.

  3. Long-context optimisation – chunking, parallel passes and multi-stage recall tame “needle-in-a-haystack” searches across million-token inputs.

  4. Interactive HTML visualisation – one command turns results into a self-contained page where extractions glow inside the source text.

  5. Flexible back-ends – swap Gemini for on-device Ollama models or any OpenAI-compatible endpoint.

  6. Domain agnosticism – the same prompt-plus-examples recipe works for finance, law, medicine or literature.

  7. Apache-2.0 licence – no gating, just pip install langextract. 

How it works in practice

A “quick-start” script pulls Shakespeare characters, emotions and relationships in about a dozen lines of code, then writes an interactive HTML overlay showing each extraction highlighted inside the play. The same pattern scales: push the full Romeo and Juliet text through three extraction passes and LangExtract surfaces hundreds of grounded entities while keeping recall high. G

The GitHub repository already counts 200+ stars less than a week after launch, and ships with examples for medication extraction and structured radiology reporting—fields where provenance and accuracy are critical. A live Hugging Face demo called RadExtract shows the library converting free-text X-ray reports into structured findings, then color-coding the original sentences that justify each data point. 

Under the hood: Gemini plus controlled generation

When you pass model_id="gemini-2.5-flash" (or -pro for harder tasks), LangExtract automatically applies Google’s controlled generation API to lock output into the schema you defined. That means fewer JSON-parse errors and cleaner downstream pipelines—something traditional LLM calls often fumble. For massive workloads, Google recommends a Tier-2 Gemini quota to avoid rate limits. 

Why developers should pay attention

Information extraction has long oscillated between hand-tuned rules (fast but brittle) and heavyweight ML pipelines (accurate but slow to build). LangExtract offers a third path: prompt-programming simplicity with enterprise-grade traceability. Because it’s open-source, teams can audit the chain of custody and fine-tune prompts to their own compliance rules instead of black-box vendor filters.

Whether you’re structuring earnings calls, tagging sentiment in product reviews, or mapping drug-dosage relationships in EMRs, LangExtract turns unreadable text into queryable data—without sacrificing transparency. For AI enthusiasts, it’s also a practical showcase of what Gemini’s long-context and schema-control features can do today.

Bottom line: install the package, craft a clear prompt, add a few gold examples, and LangExtract will handle the rest—from parallel chunking to an HTML dashboard—so you can move straight from raw documents to actionable datasets.

A virtual assistant at a laptop with app icons linked by dotted arrows Zapier for beginners in 2026 comes down to two free things: Zapier...