VinF Hybrid Inference: Define Availability values #8951

erikeldridge · 2025-04-21T19:06:47Z

LanguageModel.availability() returns Availability in TS, but a string in JS, causing the comparison to fail. Since we define the TS types for LanguageModel (for now, at least), we can define string values for the Availability enum, which enables the comparison to work as expected.

changeset-bot · 2025-04-21T19:06:51Z

⚠️ No Changeset found

Latest commit: 1cc346f

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

github-actions · 2025-04-21T19:07:02Z

Vertex AI Mock Responses Check ⚠️

A newer major version of the mock responses for Vertex AI unit tests is available. update_vertexai_responses.sh should be updated to clone the latest version of the responses: v10.0

google-oss-bot · 2025-04-21T19:16:33Z

Size Report ¹

Affected Products

@firebase/vertexai
Type Base (3d7df8b) Merge (482a1a5) Diff
browser 39.2 kB 39.1 kB -64 B (-0.2%)
main 40.2 kB 40.1 kB -64 B (-0.2%)
module 39.2 kB 39.1 kB -64 B (-0.2%)
firebase
Type Base (3d7df8b) Merge (482a1a5) Diff
firebase-vertexai.js 31.4 kB 31.4 kB -20 B (-0.1%)

Test Logs

https://storage.googleapis.com/firebase-sdk-metric-reports/Awjxlta9Pl.html

google-oss-bot · 2025-04-21T19:28:21Z

Size Analysis Report ¹

Affected Products

@firebase/vertexai
- ArraySchema
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 5.67 kB 5.65 kB -20 B (-0.4%)
  size-with-ext-deps 23.6 kB 23.6 kB -20 B (-0.1%)
- BlockReason
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.58 kB 3.56 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- BooleanSchema
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 5.68 kB 5.66 kB -20 B (-0.4%)
  size-with-ext-deps 23.6 kB 23.6 kB -20 B (-0.1%)
- ChatSession
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 16.3 kB 16.2 kB -20 B (-0.1%)
  size-with-ext-deps 35.2 kB 35.2 kB -20 B (-0.1%)
- FinishReason
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.58 kB 3.56 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- FunctionCallingMode
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.59 kB 3.57 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- GenerativeModel
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 19.6 kB 19.6 kB -20 B (-0.1%)
  size-with-ext-deps 38.6 kB 38.6 kB -20 B (-0.1%)
- HarmBlockMethod
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.59 kB 3.57 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- HarmBlockThreshold
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.59 kB 3.57 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- HarmCategory
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.58 kB 3.56 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- HarmProbability
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.59 kB 3.57 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- HarmSeverity
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.58 kB 3.56 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- ImagenAspectRatio
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.59 kB 3.57 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- ImagenImageFormat
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.87 kB 3.85 kB -20 B (-0.5%)
  size-with-ext-deps 21.8 kB 21.8 kB -20 B (-0.1%)
- ImagenModel
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 21.4 kB 21.4 kB -20 B (-0.1%)
  size-with-ext-deps 40.4 kB 40.4 kB -20 B (-0.0%)
- ImagenPersonFilterLevel
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.60 kB 3.58 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- ImagenSafetyFilterLevel
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.60 kB 3.58 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- IntegerSchema
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 5.68 kB 5.66 kB -20 B (-0.4%)
  size-with-ext-deps 23.6 kB 23.6 kB -20 B (-0.1%)
- Modality
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.58 kB 3.56 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- NumberSchema
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 5.67 kB 5.65 kB -20 B (-0.4%)
  size-with-ext-deps 23.6 kB 23.6 kB -20 B (-0.1%)
- ObjectSchema
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 5.67 kB 5.65 kB -20 B (-0.4%)
  size-with-ext-deps 23.6 kB 23.6 kB -20 B (-0.1%)
- POSSIBLE_ROLES
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.63 kB 3.61 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- Schema
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 5.67 kB 5.65 kB -20 B (-0.4%)
  size-with-ext-deps 23.6 kB 23.6 kB -20 B (-0.1%)
- SchemaType
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.58 kB 3.56 kB -20 B (-0.6%)
  size-with-ext-deps 21.5 kB 21.5 kB -20 B (-0.1%)
- StringSchema
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 5.67 kB 5.65 kB -20 B (-0.4%)
  size-with-ext-deps 23.6 kB 23.6 kB -20 B (-0.1%)
- VertexAIError
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.89 kB 3.87 kB -20 B (-0.5%)
  size-with-ext-deps 21.8 kB 21.8 kB -20 B (-0.1%)
- VertexAIModel
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 19.6 kB 19.6 kB -20 B (-0.1%)
  size-with-ext-deps 38.6 kB 38.6 kB -20 B (-0.1%)
- getGenerativeModel
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 22.2 kB 22.2 kB -20 B (-0.1%)
  size-with-ext-deps 41.2 kB 41.2 kB -20 B (-0.0%)
- getImagenModel
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 21.6 kB 21.5 kB -20 B (-0.1%)
  size-with-ext-deps 40.5 kB 40.5 kB -20 B (-0.0%)
- getVertexAI
  Size
  Type Base (3d7df8b) Merge (482a1a5) Diff
  size 3.76 kB 3.74 kB -20 B (-0.5%)
  size-with-ext-deps 29.0 kB 29.0 kB -20 B (-0.1%)

Test Logs

https://storage.googleapis.com/firebase-sdk-metric-reports/up0Vt2oWOi.html

erikeldridge · 2025-04-21T22:16:19Z

"Test Modified Packages / Test Packages With Changed Files in Webkit (pull_request)" doesn't seem obviously Firestore- or Auth-related, but IIUC, the failure also doesn't seem VinF-related:

lerna ERR! yarn run test:ci exited 1 in '@firebase/data-connect'

Given the above, I'll go ahead and merge.

Fix languageCode parameter in action_code_url (#8912) * Fix languageCode parameter in action_code_url * Add changeset Vaihi add langmodel types. (#8927) * Adding LanguageModel types. These are based off https://github.com/webmachinelearning/prompt-api?tab=readme-ov-file#full-api-surface-in-web-idl * Adding LanguageModel types. * Remove bunch of exports * yarn formatted * after lint Define HybridParams (#8935) Co-authored-by: Erik Eldridge <[email protected]> Adding smoke test for new hybrid params (#8937) * Adding smoke test for new hybrid params * Use the existing name of the model params input --------- Co-authored-by: Erik Eldridge <[email protected]> Moving to in-cloud naming (#8938) Co-authored-by: Erik Eldridge <[email protected]> Moving to string type for the inference mode (#8941) Define ChromeAdapter class (#8942) Co-authored-by: Erik Eldridge <[email protected]> VinF Hybrid Inference: Implement ChromeAdapter (rebased) (#8943) Adding count token impl (#8950) VinF Hybrid Inference #4: ChromeAdapter in stream methods (rebased) (#8949) Define values for Availability enum (#8951) VinF Hybrid Inference: narrow Chrome input type (#8953) Add image inference support (#8954) * Adding image based input for inference * adding image as input to create language model object disable count tokens api for on-device inference (#8962) VinF Hybrid Inference: throw if only_on_device and model is unavailable (#8965)

Fix languageCode parameter in action_code_url (#8912) * Fix languageCode parameter in action_code_url * Add changeset Vaihi add langmodel types. (#8927) * Adding LanguageModel types. These are based off https://github.com/webmachinelearning/prompt-api?tab=readme-ov-file#full-api-surface-in-web-idl * Adding LanguageModel types. * Remove bunch of exports * yarn formatted * after lint Define HybridParams (#8935) Co-authored-by: Erik Eldridge <[email protected]> Adding smoke test for new hybrid params (#8937) * Adding smoke test for new hybrid params * Use the existing name of the model params input --------- Co-authored-by: Erik Eldridge <[email protected]> Moving to in-cloud naming (#8938) Co-authored-by: Erik Eldridge <[email protected]> Moving to string type for the inference mode (#8941) Define ChromeAdapter class (#8942) Co-authored-by: Erik Eldridge <[email protected]> VinF Hybrid Inference: Implement ChromeAdapter (rebased) (#8943) Adding count token impl (#8950) VinF Hybrid Inference #4: ChromeAdapter in stream methods (rebased) (#8949) Define values for Availability enum (#8951) VinF Hybrid Inference: narrow Chrome input type (#8953) Add image inference support (#8954) * Adding image based input for inference * adding image as input to create language model object disable count tokens api for on-device inference (#8962) VinF Hybrid Inference: throw if only_on_device and model is unavailable (#8965) VinF Hybrid Inference: update docs (#8970) VinF Hybrid Inference: consolidate onDeviceParams initialization (#8969) VinF Hybrid Inference: disable multi-turn support (#8973) VinF Hybrid Inference: remove default expected input types (#8974) VinF Hybrid Inference: set image (and text) as default input type (#8984) VinF Hybrid Inference: log debug messages in conditional logic (#8992)

--------- Co-authored-by: Erik Eldridge <[email protected]> Moving to in-cloud naming (#8938) Co-authored-by: Erik Eldridge <[email protected]> Moving to string type for the inference mode (#8941) Define ChromeAdapter class (#8942) Co-authored-by: Erik Eldridge <[email protected]> VinF Hybrid Inference: Implement ChromeAdapter (rebased) (#8943) Adding count token impl (#8950) VinF Hybrid Inference #4: ChromeAdapter in stream methods (rebased) (#8949) Define values for Availability enum (#8951) VinF Hybrid Inference: narrow Chrome input type (#8953) Add image inference support (#8954) * Adding image based input for inference * adding image as input to create language model object disable count tokens api for on-device inference (#8962) VinF Hybrid Inference: throw if only_on_device and model is unavailable (#8965) VinF Hybrid Inference: update docs (#8970) VinF Hybrid Inference: consolidate onDeviceParams initialization (#8969) VinF Hybrid Inference: disable multi-turn support (#8973) VinF Hybrid Inference: remove default expected input types (#8974) VinF Hybrid Inference: set image (and text) as default input type (#8984) VinF Hybrid Inference: log debug messages in conditional logic (#8992) VinF Hybrid Inference: support structured output (#9009)

Define values for Availability enum

1cc346f

erikeldridge requested a review from a team as a code owner April 21, 2025 19:06

erikeldridge merged commit 622916c into vaihi-exp Apr 21, 2025
29 of 45 checks passed

erikeldridge deleted the erikeldridge-vertex-availability branch April 21, 2025 22:16

gsiddh pushed a commit that referenced this pull request Apr 22, 2025

Define values for Availability enum (#8951)

ab68ce0

gsiddh pushed a commit that referenced this pull request Apr 22, 2025

Define values for Availability enum (#8951)

ee81092

gsiddh mentioned this pull request Apr 23, 2025

Complete Hybrid inference impl #8966

Open

VinF Hybrid Inference: Define Availability values #8951

VinF Hybrid Inference: Define Availability values #8951

Conversation

erikeldridge commented Apr 21, 2025

changeset-bot bot commented Apr 21, 2025

⚠️ No Changeset found

github-actions bot commented Apr 21, 2025

Vertex AI Mock Responses Check ⚠️

google-oss-bot commented Apr 21, 2025

Size Report 1

Affected Products

@firebase/vertexai

firebase

Test Logs

google-oss-bot commented Apr 21, 2025

Size Analysis Report 1

Affected Products

@firebase/vertexai

ArraySchema

BlockReason

BooleanSchema

ChatSession

FinishReason

FunctionCallingMode

GenerativeModel

HarmBlockMethod

HarmBlockThreshold

HarmCategory

HarmProbability

HarmSeverity

ImagenAspectRatio

ImagenImageFormat

ImagenModel

ImagenPersonFilterLevel

ImagenSafetyFilterLevel

IntegerSchema

Modality

NumberSchema

ObjectSchema

POSSIBLE_ROLES

Schema

SchemaType

StringSchema

VertexAIError

VertexAIModel

getGenerativeModel

getImagenModel

getVertexAI

Test Logs

erikeldridge commented Apr 21, 2025

Size Report ¹

`@firebase/vertexai`

`firebase`

Size Analysis Report ¹

`@firebase/vertexai`

`ArraySchema`

`BlockReason`

`BooleanSchema`

`ChatSession`

`FinishReason`

`FunctionCallingMode`

`GenerativeModel`

`HarmBlockMethod`

`HarmBlockThreshold`

`HarmCategory`

`HarmProbability`

`HarmSeverity`

`ImagenAspectRatio`

`ImagenImageFormat`

`ImagenModel`

`ImagenPersonFilterLevel`

`ImagenSafetyFilterLevel`

`IntegerSchema`

`Modality`

`NumberSchema`

`ObjectSchema`

`POSSIBLE_ROLES`

`Schema`

`SchemaType`

`StringSchema`

`VertexAIError`

`VertexAIModel`

`getGenerativeModel`

`getImagenModel`

`getVertexAI`