Skip to content

[Firebase AI] Add URLContext tool #15221

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Sep 23, 2025
Merged

[Firebase AI] Add URLContext tool #15221

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
0b97b88
[Firebase AI] Add `URLContext` tool
andrewheard Aug 18, 2025
85a152f
Add `URLContextMetadata` to `Candidate`
andrewheard Sep 5, 2025
b1425ee
Update integration test to check the `URLContextMetadata`
andrewheard Sep 5, 2025
35287ab
Update availability annotations
andrewheard Sep 5, 2025
d5fcfa7
Fix DocC formatting
andrewheard Sep 6, 2025
b86db56
Add `toolUsePromptTokenCount` and `toolUsePromptTokensDetails`
andrewheard Sep 6, 2025
0d41dc3
Add `toolUsePromptTokenCount` and `toolUsePromptTokensDetails` tests
andrewheard Sep 6, 2025
23818a8
Fixes after rebasing
paulb777 Sep 16, 2025
2cef56e
[Firebase AI] Make `URLContext` struct internal (#15335)
andrewheard Sep 17, 2025
1fe4d88
[AI] API docs for URLContext (#15341)
paulb777 Sep 19, 2025
e02fd29
[AI] Unit tests for urlContext APIs (#15343)
paulb777 Sep 22, 2025
a6e0ce8
Add changelog
paulb777 Sep 22, 2025
f9b0504
More explanatory changelog
paulb777 Sep 22, 2025
0d9d3e9
One more changelog tweak
paulb777 Sep 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add toolUsePromptTokenCount and toolUsePromptTokensDetails
  • Loading branch information
@andrewheard @paulb777
andrewheard authored and paulb777 committed Sep 22, 2025
commit b86db5655d3523f7d41e1f3aae9e52c6e993c295
13 changes: 13 additions & 0 deletions FirebaseAI/Sources/GenerateContentResponse.swift
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,9 @@ public struct GenerateContentResponse: Sendable {
/// The total number of tokens across the generated response candidates.
public let candidatesTokenCount: Int

/// The number of tokens present in tool-use prompt(s).
public let toolUsePromptTokenCount: Int

/// The number of tokens used by the model's internal "thinking" process.
///
/// For models that support thinking (like Gemini 2.5 Pro and Flash), this represents the actual
Expand All @@ -44,6 +47,9 @@ public struct GenerateContentResponse: Sendable {

/// The breakdown, by modality, of how many tokens are consumed by the candidates
public let candidatesTokensDetails: [ModalityTokenCount]

/// List of modalities that were processed for tool-use request inputs.
public let toolUsePromptTokensDetails: [ModalityTokenCount]
}

/// A list of candidate response content, ordered from best to worst.
Expand Down Expand Up @@ -474,17 +480,21 @@ extension GenerateContentResponse.UsageMetadata: Decodable {
enum CodingKeys: CodingKey {
case promptTokenCount
case candidatesTokenCount
case toolUsePromptTokenCount
case thoughtsTokenCount
case totalTokenCount
case promptTokensDetails
case candidatesTokensDetails
case toolUsePromptTokensDetails
}

public init(from decoder: any Decoder) throws {
let container = try decoder.container(keyedBy: CodingKeys.self)
promptTokenCount = try container.decodeIfPresent(Int.self, forKey: .promptTokenCount) ?? 0
candidatesTokenCount =
try container.decodeIfPresent(Int.self, forKey: .candidatesTokenCount) ?? 0
toolUsePromptTokenCount =
try container.decodeIfPresent(Int.self, forKey: .toolUsePromptTokenCount) ?? 0
thoughtsTokenCount = try container.decodeIfPresent(Int.self, forKey: .thoughtsTokenCount) ?? 0
totalTokenCount = try container.decodeIfPresent(Int.self, forKey: .totalTokenCount) ?? 0
promptTokensDetails =
Expand All @@ -493,6 +503,9 @@ extension GenerateContentResponse.UsageMetadata: Decodable {
[ModalityTokenCount].self,
forKey: .candidatesTokensDetails
) ?? []
toolUsePromptTokensDetails = try container.decodeIfPresent(
[ModalityTokenCount].self, forKey: .toolUsePromptTokensDetails
) ?? []
}
}

Expand Down