MDP
Technology & Computing abbreviation · Artificial Intelligence
| Stands for | Markov decision process |
|---|---|
| Categories | Technology & Computing |
MDP stands for Markov decision process, an artificial intelligence abbreviation.
A mathematical framework for sequential decision-making, defined by states, actions, transition probabilities and rewards, in which the next state depends only on the current state and action. It is the formal foundation of reinforcement learning.
Example: Frame the inventory problem as an MDP, with stock levels as states and order sizes as actions.
Usage notes
Developed in the 1950s, notably by Richard Bellman, whose equations define optimal values. The "Markov property" means the future is independent of the past given the present. When states are only partly observable, the framework becomes a POMDP.
Related abbreviations
More artificial intelligence abbreviations
- LMM – Large multimodal model
- LoRA – Low-rank adaptation
- LSTM – Long short-term memory
- MAE – Mean absolute error
- mAP – Mean average precision
- MCP – Model Context Protocol
- ML – Machine learning
- MLE – Maximum likelihood estimation
- MLOps – Machine learning operations
- MLP – Multilayer perceptron
- MMLU – Massive Multitask Language Understanding
- MoE – Mixture of experts