Skip to content

Releases: mlflow/mlflow

v3.2.0

06 Aug 03:23
e1de6be

Choose a tag to compare

MLflow 3.2.0 includes several major features and improvements

Major New Features

📊 Usage Tracking (New in 3.2.0)

  • Starting with version 3.2.0, MLflow will begin collecting anonymized usage data about how core features of the platform are used. This data contains no sensitive or personally identifiable information, and users can opt out of data collection at any time. Check MLflow documentation for more details. If you have questions or feedback, please visit this Github Issue. (#16439, @serena-ruan)

Features:

Bug fixes:

  • [Tracking / UI] Add missing default headers and replace absolute URLs in new browser client requests (GraphQL & logged models) (#16840, @danilopeixoto)
  • [Tracking] Fix tracking_uri positional argument bug in artifact repositories (#16878, @copilot-swe-agent)
  • [Models] Fix UnionType support for Python 3.10 style union syntax (#16882, @harupy)
  • [Tracing / Tracking] Fix OpenAI autolog Pydantic validation for enum values (#16862, @mohammadsubhani)
  • [Tracking] Fix tracing for Anthropic and Langchain combination (#15151, @maver1ck)
  • [Models] Fix OpenAI multimodal message logging support (#16795, @mohammadsubhani)
  • [Tracing] Avoid using nested threading for Azure Databricks trace export (#16733, @TomeHirata)
  • [Evaluation] Bug fix: Databricks GenAI evaluation dataset source returns string, instead of DatasetSource instance (#16712, @dbczumar)
  • [Models] Fix get_model_info to provide logged model info (#16713, @harupy)
  • [Evaluation] Fix serialization and deserialization for python scorers (#16688, @connorchenn)
  • [UI] Fix GraphQL handler erroring on NaN metric values (#16628, @daniellok-db)
  • [UI] Add back video artifact preview (#16620, @daniellok-db)
  • [Tracing] Proper chat message reconstruction from OAI streaming response (#16519, @B-Step62)
  • [Tracing] Convert trace column in search_traces() response to JSON string (#16523, @B-Step62)
  • [Evaluation] Fix mlflow.evaluate crashes in _get_binary_classifier_metrics due to … (#16485, @mohammadsubhani)
  • [Evaluation] Fix trace detection logic for mlflow.genai.evaluate (#16932, @B-Step62)
  • [Evaluation] Enable to use make_genai_metric_from_prompt for mlflow.evaluate (#16960, @TomeHirata)
  • [Models] Add explicit encoding for decoding streaming Responses (#16855, @aravind-segu)
  • [Tracking] Prevent from tracing DSPy model API keys (#17021, @czyzby)
  • [Tracking] Fix pytorch datetime issue (#17030, @serena-ruan)
  • [Tracking] Fix predict with pre-releases (#16998, @serena-ruan)

Documentation updates:

Small bug fixes and documentation updates:

#17003, #17049, #17035, #17026, #16981, #16971, #16953, #16930, #16917, #16738, #16717, #16693, #16694, #16684, #16678, #16656, #16513, #16459, #16277, #16276, #16275, #16170, #16217, @serena-ruan; #16927, #16915, #16913, #16911, #16909, #16889, #16727, #16600, #16543, #16551, #16526, #16533, #16535, #16531, #16472, #16392, #16389, #16385, #16376, #16369, #16367, #16321, #16311, #16307, #16273, #16268, #16265, #16112, #16243, #16231, #16226, #16221, #16196, @copilot-swe-agent; #17050, #17048, #16955, #16894, #16885, #16860, #16841, #16835, #16801, #16701, @daniellok-db; #16898, #16881, #16858, #16735, #16823, #16814, #16647, #16750, #16809, #16794, #16793, #16789, #16780, #16770, #16773, #16771, #16772, #16768, #16752, #16754, #16751, #16748, #16730, #16729, #16346, #16709, #16704, #16703, #16702, #16658, #16662, #16645, #16639, #16640, #16626, #16572, #16566, #16565, #16563, #16561, #16559, #16544, #16539, #16520, #16508, #16505, #16494, #16495, #16491, #16487, #16482, #16473, #16465, #16456, #16458, #16394, #16445, #16433, #16434, #16413, #16417, #16416, #16414, #16415, #16378, #16350, #16323, #15788, #16263, #16256, #16237, #16234, #16219, #16216, #16207, #16199, #16192, #16705, @harupy; #17047, #17017, #17005, #16989, #16952, #16951, #16903, #16900, #16755, #16762, #16757, #15860, #16661, #16630, #16657, #16605, #16602, #16568, #16569, #16553, #16345, #16454, #16489, #16486, #16438, #16266, #16382, #16381, #16303, @B-Step62; #17028, #17027, #17020, @he7d3r; #16969, #16957, #16852, #16829, #16816, #16808, #16775, #16807, #16806, #16624, #16524, #16410, #16403, @TomeHirata; #16987, @wangh118; #16760, #16761, #16736, #16737, #16699, #16718, #16663, #16676, #16574, #16477, #16552, #16527, #16515, #16452, #16210, #16204, #16610, @frontsideair; #16723, #16124, @AveshCSingh; #16744, @BenWilson2; #16683, @dsuhinin; #16877, #16502, @bbqiu; #16619, @AchimGaedkeLynker; #16595, @Aiden-Jeon; #16480, #16479, @shushantrishav; #16398, #16331, #16328, #16329, #16293, @WeichenXu123

v3.2.0rc0

29 Jul 14:53

Choose a tag to compare

v3.2.0rc0 Pre-release
Pre-release

📊 Usage Tracking (New in 3.2.0)

  • Starting with version 3.2.0, MLflow will begin collecting anonymized usage data about how core features of the platform are used. This data contains no sensitive or personally identifiable information, and users can opt out of data collection at any time. Check MLflow documentation for more details. If you have questions or feedback, please visit this Github Issue. (#16439, @serena-ruan)

Features:

Bug fixes:

  • [Tracing] Proper chat message reconstruction from OAI streaming response (#16519, @B-Step62)
  • [Tracing] Convert trace column in search_traces() response to JSON string (#16523, @B-Step62)
  • [Evaluation] Fix mlflow.evaluate crashes in _get_binary_classifier_metrics due to … (#16485, @mohammadsubhani)

Documentation updates:

Small bug fixes and documentation updates:

#16930, #16917, #16738, #16717, #16693, #16694, #16684, #16678, #16656, #16513, #16459, #16277, #16276, #16275, #16170, #16217, @serena-ruan; #16927, #16915, #16913, #16911, #16909, #16889, #16727, #16600, #16543, #16551, #16526, #16533, #16535, #16531, #16472, #16392, #16389, #16385, #16376, #16369, #16367, #16321, #16311, #16307, #16273, #16268, #16265, #16112, #16243, #16231, #16226, #16221, #16196, @copilot-swe-agent; #16894, #16885, #16860, #16841, #16835, #16801, #16701, @daniellok-db; #16898, #16881, #16858, #16735, #16823, #16814, #16647, #16750, #16809, #16794, #16793, #16789, #16780, #16770, #16773, #16771, #16772, #16768, #16752, #16754, #16751, #16748, #16730, #16729, #16346, #16709, #16704, #16703, #16702, #16658, #16662, #16645, #16639, #16640, #16626, #16572, #16566, #16565, #16563, #16561, #16559, #16544, #16539, #16520, #16508, #16505, #16494, #16495, #16491, #16487, #16482, #16473, #16465, #16456, #16458, #16394, #16445, #16433, #16434, #16413, #16417, #16416, #16414, #16415, #16378, #16350, #16323, #15788, #16263, #16256, #16237, #16234, #16219, #16216, #16207, #16199, #16192, #16705, @harupy; #16900, #16755, #16762, #16757, #15860, #16661, #16630, #16657, #16605, #16602, #16568, #16569, #16553, #16345, #16454, #16489, #16486, #16438, #16266, #16382, #16381, #16303, @B-Step62; #16852, #16829, #16816, #16808, #16775, #16807, #16806, #16624, #16524, #16410, #16403, @TomeHirata; #16760, #16761, #16736, #16737, #16699, #16718, #16663, #16676, #16574, #16477, #16552, #16527, #16515, #16452, #16210, #16204, #16610, @frontsideair; #16723, #16124, @AveshCSingh; #16744, @BenWilson2; #16683, @dsuhinin; #16502, @bbqiu; #16619, @AchimGaedkeLynker; #16595, @Aiden-Jeon; #16480, #16479, @shushantrishav; #16398, #16331, #16328, #16329, #16293, @WeichenXu123

v3.1.4

23 Jul 06:33

Choose a tag to compare

MLflow 3.1.4 includes several major features and improvements

Small bug fixes and documentation updates:

#16835, #16820, @daniellok-db

v3.1.3

22 Jul 13:22

Choose a tag to compare

MLflow 3.1.3 includes several features and improvements

Features:

  • [Artifacts / Tracking] Do not copy file permissions when logging artifacts to local artifact repo (#16642, @connortann)
  • [Tracking] Add support for OpenAI ChatCompletions parse method (#16493, @harupy)

Bug fixes:

  • [Deployments] Propagate MLFLOW_DEPLOYMENT_PREDICT_TIMEOUT to databricks-sdk (#16783, @bbqiu)
  • [Model Registry] Fix issue with search_registered_models with Databricks UC backend not supporting filter_string (#16766, @BenWilson2)
  • [Evaluation] Bug fix: Databricks GenAI evaluation dataset source returns string, instead of DatasetSource instance (#16712, @dbczumar)
  • [Tracking] Fix the position of added tracking_uri param to artifact store implementations (#16653, @BenWilson2)

Small bug fixes and documentation updates:

#16786, #16692, @daniellok-db; #16594, @ngoduykhanh; #16475, @harupy

v3.1.2

18 Jul 02:24

Choose a tag to compare

Warning

This version has been yanked. MLflow 3.1.3 will be released shortly.

MLflow 3.1.2 is a patch release that includes several bug fixes.

Bug fixes:

  • [Tracking] Fix download_artifacts ignoring tracking_uri parameter (#16461, @harupy)
  • [Models] Fix event type for ResponsesAgent error (#16427, @bbqiu)
  • [Models] Remove falsey chat conversion for LangGraph models (#16601, @B-Step62)
  • [Tracing] Use empty Resource when instantiating OTel provider to fix LiteLLM tracing issue (#16590, @B-Step62)

Small fixes and documentation updates:

#16568, #16454, #16617, #16605, #16569, #16553, #16625, @B-Step62; #16571, #16552, #16452, #16395, #16446, #16420, #16447, #16554, #16515, @frontsideair; #16558, #16443, #16457, @16442, #16449, @harupy; #16509, #16512, #16524, #16514, #16607, @TomeHirata; #16541, @copilot-swe-agent; #16427, @bbqiu; #16573, @daniellok-db; #16470, #16281, @BenWilson2

v3.1.1

25 Jun 10:15
ace0a2c

Choose a tag to compare

MLflow 3.1.1 includes several major features and improvements

Features:

  • [Model Registry / Sqlalchemy] Increase prompt text limit from 5K to 100K (#16377, @harupy)
  • [Tracking] Support pagination in get-history of FileStore and SqlAlchemyStore (#16325, @TomeHirata)

Bug fixes:

  • [Artifacts] Support downloading logged model artifacts (#16356, @TomeHirata)
  • [Models] Fix bedrock provider, configured inference profile compatibility (#15604, @lloydhamilton)
  • [Tracking] Specify attribute.run_id when search_traces filters by run_id (#16295, @artjen)
  • [Tracking] Fix graphql batching attacks (#16227, @serena-ruan)
  • [Model Registry] Make the chunk size configurable in DatabricksSDKModelsArtifactRepository (#16247, @TomeHirata)

Documentation updates:

Small bug fixes and documentation updates:

#16261, @rohitarun-db; #16411, #16352, #16327, #16324, #16279, #16193, #16197, @harupy; #16409, #16348, #16347, #16290, #16286, #16283, #16271, #16223, @TomeHirata; #16326, @mohammadsubhani; #16364, @BenWilson2; #16308, #16218, @serena-ruan; #16262, @raymondzhou-db; #16191, @copilot-swe-agent; #16212, @B-Step62; #16208, @frontsideair; #16205, #16200, #16198, @daniellok-db

v3.0.1

25 Jun 09:36
cc9451a

Choose a tag to compare

MLflow 3.0.1 includes several major features and improvements

Features:

  • [Model Registry / Sqlalchemy] Increase prompt text limit from 5K to 100K (#16377, @harupy)

Bug fixes:

  • [Models] Fix bedrock provider, configured inference profile compatibility (#15604, @lloydhamilton)

Small bug fixes and documentation updates:

#16364, @BenWilson2; #16347, @TomeHirata; #16279, #15835, @harupy; #16182, @B-Step62

3️⃣ MLflow 3 3️⃣

10 Jun 19:08
39a419b

Choose a tag to compare

MLflow 3: Redefining MLOps for the GenAI Era

Screenshot 2025-06-12 at 3 20 33

MLflow 3 is now available to everyone, marking the biggest evolution in the best open-source MLOps platform's history and transforming how millions of developers build, deploy, AI applications. While previous versions focused on traditional ML workflows, MLflow 3 fundamentally reimagines the platform for the GenAI era. This isn't just an update, but a complete paradigm shift that brings enterprise-grade GenAI capabilities to the open source community for the first time.

🎯 Improved Model Tracking for GenAI

MLflow 3 introduces a refined architecture with the new LoggedModel entity as a first-class citizen, moving beyond the traditional run-centric approach. This enables better organization and comparison of GenAI models. agents, deep learning checkpoints, and model variants across experiments.

🔗 Comprehensive Performance Tracking & Observability

Enhanced model tracking provides comprehensive lineage between models, runs, traces, prompts, and evaluation metrics. The new model-centric design allows you to group traces and metrics from different development environments and production, enabling rich comparisons across model versions.

📊 Production-Grade GenAI Evaluation

MLflow's evaluation and monitoring capabilities help you systematically measure, improve, and maintain the quality of your GenAI applications throughout their lifecycle. From development through production, use the same quality scorers to ensure your applications deliver accurate, reliable responses while managing cost and latency. Visit documentation for more details.

👥 Human-in-the-Loop Feedback

Real-world GenAI applications need human oversight. MLflow 3 now tracks human annotations and feedback for model predictions, enabling streamlined human-in-the-loop evaluation cycles. This creates a collaborative environment where data scientists, domain experts, and stakeholders can efficiently improve model quality together.
(Note: Currently available in Databricks Managed MLflow. Open source release coming in the next few months.)

⚡️ State-of-the-Art Prompt Optimization

Transform prompt engineering from art to science. The MLflow Prompt Registry now includes prompt optimization capabilities built on top of the state-of-the-art research, allowing you to automatically improve prompts using evaluation feedback and labeled datasets. This includes versioning, tracking, and systematic prompt engineering workflows.

📚 Revamped Website and Documentation

The MLflow documentation and website has been fully redesigned to support two main user journeys: GenAI development and classic machine learning workflows. The new structure offers dedicated sections for GenAI features (including LLMs, prompt engineering, and tracing), and traditional ML capabilities such as experiment tracking, model registry, deployment, and evaluation.

▶︎▶︎▶︎ Ready to Get Started? ▶︎▶︎▶︎

Get up and running with MLflow 3 in minutes:

pip install 'mlflow>=3.1'

Resources:

🌐 New Website | 📖 Documentation | 🎉:Release Notes

🏎️ The Road Ahead 🏎️

It is just the beginning. The open source community continues driving innovation toward the world's best open-source MLOps/LLMOps platform. Here's how you can be part of the journey:

How to Get Involved:

  • 🔧 Contribute Code: From bug fixes to major features, all contributions welcome
  • 🐝 Report Issues: Help us improve by reporting bugs and requesting features
  • 💬 Join Discussions: Technical discussions, roadmap planning, and peer support
  • 📝 Share Your Story: Write blogs, tutorials, and docs about your MLflow implementations to help others learn!

The future of AI development is unified, observable, and reliable. MLflow 3.0 brings that future to the open source community today.

Ready to transform your GenAI workflow? Get started now →

Changelog

  • [Tracking] MLflow 3.0 (#13211, @harupy)
  • [Prompts] Add Custom Prompt Judges to mlflow[databricks] (#16097, @dbrx-euirim)
  • [Artifacts / Model Registry / Tracking] Package model environment when registering model (#15783, @qyc)
  • [Tracking] Add MlflowSparkStudy (#15418, @lu-wang-dl)
  • [Scoring] Make spark_udf support DBConnect + DBR 15.4 / DBR dedicated cluster (#15968, @WeichenXu123)
  • [Tracking] Lock model dependencies when logging a model using uv (#15875, @harupy)
  • [Model Registry] Introduce mlflow.genai.optimize_prompt to optimize prompts (#15861, @TomeHirata)
  • [Tracing] Support custom request/response preview (#15919, @B-Step62)
  • [Tracking] Add integration for AutoGen > 0.4 (#14729, @TomeHirata)
  • [Tracking] Support token tracking for OpenAI (#15870, @B-Step62)
  • [Tracking] Support tracing ResponsesAgent.predict_stream (#15762, @bbqiu)
  • [Tracking] Introduce client and fluent APIs for LogLoggedModelParams (#15717, @artjen)
  • [Models] Support predict_stream in DSPy flavor (#15678, @TomeHirata)
  • [Tracking] Record notebook and git metadata in trace metadata (#15650, @B-Step62)
  • [Model Registry] Added search_prompts function to list all the prompts registered (#15445, @joelrobin18)
  • [Models] Support compression for pyfunc log model (#14700, @antbbn)
  • [Gateway] Add support for Gemini in AI Gateway (#15069, @joelrobin18)
  • [Tracing] PydanticAI Autologging (#15553, @joelrobin18)
  • [Tracking] Support setting databricks auth profile by DATABRICKS_CONFIG_PROFILE environment variable. (#15587, @WeichenXu123)
  • [Tracking] create mlflow tracing for smolagents (#15574, @y-okt)
  • [Artifacts / UI] Support for video artifacts (#15518, @joelrobin18)
  • [Model Registry] Add allow_missing parameter in load_prompt (#15371, @joelrobin18)
  • [Tracking] Emit a warning for mlflow.get_artifact_uri() usage outside active run (#12902, @Shashank1202)

Bug fixes:

  • [GenAI] Add Databricks App resource (#15867, @aravind-segu)
  • [Tracking] Support json-string for inputs/expectations column in Spark Dataframe (#16011, @B-Step62)
  • [Tracking] Avoid generating traces from scorers during evaluation (#16004, @B-Step62)
  • [GenAI] Allow multi inputs module in DSPy (#15859, @TomeHirata)
  • [Tracking] Improve error handling if tracking URI is not set when running mlflow gc (#11773, @oleg-z)
  • [Tracking] Trace search: Avoid spawning threads for span fetching if include_spans=False (#15634, @dbczumar)
  • [Tracking] Fix global_guideline_adherence (#15572, @artjen)
  • [Model Registry] Log Resources from SystemAuthPolicy in CreateModelVersion (#15485, @aravind-segu)
  • [Models] ResponsesAgent interface update (#15601, #15741, @bbqiu)

Breaking changes:

  • [Tracking] Move prompt registry APIs under mlflow.genai.prompts namespace (#16174, @B-Step62)
  • [Model Registry] Default URI to databricks-uc when tracking URI is databricks & registry URI is unspecified (#16135, @dbczumar)
  • [Tracking] Do not log SHAP explainer in mlflow.evaluate (#15827, @harupy)
  • [Tracking] Update DataFrame schema returned from mlflow.search_trace() to be V3 format (#15643, @B-Step62)

Documentation updates:

Small bug fixes and documentation updates:

#16193, #16192, #16171, #16119, #16036, #16130, #16081, #16101, #16047, #16086, #16077, #16045, #16065, #16067, #16063, #16061, #16058, #16050, #16043, #16034, #16033, #15966, #16025, #16015, #16002, #15970, #16001, #15999, #15942, #15960, #15955, #15951, #15939, #15885, #15883, #15890, #15887, #15874, #15869, #15846, #15845, #15826, #15834, #15822, #15830, #15796, #15821, #15818, #15817, #15805, #15804, #15798, #15793, #15797, #15782, #15775, #15772, #15790, #15773, #15776, #15756, #15767, #15766, #15765, #15746, #15747, #15748, #15751, #15743, #15731, #15720, #15722, #15670, #15614, #15715, #15677, #15708, #15673, #15680, #15686, #15671, #15657, #15669, #15664, #15675, #15667, #15666, #15668, #15651, #15649, #15647, #15640, #15638, #15630, #15627, #15624, #15622, #15558, #15610, #15577, #15575, #15545, #15576, #15559, #15563, #15555, #15557, #15548, #15551, #15547, #15542, #15536, #15524, #15531, #15525, #15520, #15521, #15502, #15499, #15442, #15426, #15315, #15392, #15397, #15399, #15394, #15358, #15352, #15349, #15328, #15336, #15335, @harupy; #16196, #16191, #16093, #16114, #16080, #16088, #16053, #15856, #16039, #15987, #16009, #16014, #16007, #15996, #15993, #15991, #15989, #15978, #15839, #15953, #15934, #15929, #15926, #15909, #15900, #15893, #15889, #15881, #15879, #15877, #15865, #15863, #15854, #15852, #15848, @copilot-swe-agent; #16178, #16153, #16155, #15823, #15754, #15794, #15800, #15799, #15615, #15777, #15726, #15752, #15745, #15753, #15738, #15681, #15684, #15682, #15702,...

Read more

v3.0.0

11 Jun 23:55
43b4091

Choose a tag to compare

v2.22.1

06 Jun 09:02
491aac5

Choose a tag to compare

MLflow 2.22.1 includes several major features and improvements

Features:

  • [Scoring] For DBConnect client, make spark_udf support DBR 15.4 and DBR dedicated cluster (#15938, @WeichenXu123)

Bug fixes:

  • [Model Registry] Log Resources from SystemAuthPolicy in CreateModelVersion (#15485, @aravind-segu)
  • [Tracking] Trace search: Avoid spawning threads for span fetching if include_spans=False (#, @dbczumar)

Documentation updates:

Small bug fixes and documentation updates:

#15523, #15728, @TomeHirata; #13997, #16025, #15647, #16030, @harupy; #15786, @rahuja23; #15703, @joelrobin18; #15612, @serena-ruan; #16031, @daniellok-db; #15841, @frontsideair; #15807, @B-Step62