Hacker NewsHN submitter: softwaredoug
Original published:

Build your own decision model

The article explains the concept of 'System 1' decision-making models, referencing LLM Structured Output and model prefilling to provide a perspective on model construction involving probabilistic reasoning.

Key points

  • •A 'System 1' decision-making model refers to one that reasons and responds with calibrated probabilities for all permitted answers.
  • •To obtain typed outputs like JSON from an LLM, one should use Structured Output to constrain the output to a valid format.
  • •The article mentions that model prefilling involves processing the input in a single pass.
See more