Skip to content

Latest commit

 

History

History
91 lines (57 loc) · 1.36 KB

index.org

File metadata and controls

91 lines (57 loc) · 1.36 KB

Xs and Ys

AI SaaS

Software Quality

Example: ?

  • ?
  • ?

AI Software Quality

  • ?
  • ?

We want a shared understanding of AI Software and its Quality

Why does it matter?

We found that driving true business impact is amazingly hard, plus it is difficult to isolate and understand the connection between efforts on modeling and the observed impact… Our main conclusion is that an iterative, hypothesis driven process, integrated with other disciplines was fundamental to build 150 successful products enabled by machine learning.

AI Software

Code + Data

AI Software

./images/ais.png

Data

Xs and Ys

./images/xy.png

More examples

  1. ?
  2. ?
  3. ?

No Ys

./images/anomaly.png

Other Factors in Production

  • Source type
  • Supervision style
  • Quality

Spotify Radio

./images/spotify-radio.png

Spotify Radio in VIVA

?

How to build High Quality AIS?

Key learnings

  • Feedback
  • Iterations

Platform

./images/tfx.png

Platform

As we moved the Google Play ranking system from its previous version to TFX, we saw an increased velocity of iterating on new experiments, reduced technical debt, and improved model quality.

MLOps

./images/mlops.svg

?

@abhinav on slack