Company
Mitchell Bryson AI Reliability Articles
GPT‑Live, Google Photos’ Video Remix and Meta’s always-on AI glasses all point in the same direction: AI is moving out of the chat window and into voice, camera rolls and wearables. The product opportunity is enormous, but so is the trust problem, as...
OpenAI Evaluation Filter
A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in evaluating AI models.
METR Blog
Note on independence: This evaluation was conducted under a standard NDA. Due to the sensitive information shared with METR as part of this evaluation, OpenAI’s comms and legal team required review and approval of this post.1 Summary We conducted an...
OpenAI Evaluation Filter
OpenAI helps build shared standards for advanced AI, supporting evaluation frameworks, safety practices, and global cooperation through the Appia Foundation.
OpenAI Evaluation Filter
OpenAI introduces Deployment Simulation, a method to predict AI model behavior before deployment using real conversation data to improve safety and evaluation accuracy.
OpenAI Evaluation Filter
OpenAI frontier models and Codex are now generally available on AWS, giving enterprises a new path to build with OpenAI through the AWS environments, controls, and procurement workflows they already use. Customers can get started with OpenAI on AWS and move...
OpenAI Evaluation Filter
OpenAI launches Rosalind Biodefense, expanding trusted access to GPT-Rosalind for vetted developers and U.S. government partners advancing biodefense, public health, and pandemic preparedness through frontier AI.
OpenAI Evaluation Filter
OpenAI shares guidance on third-party AI evaluations, covering how to assess model capabilities, safeguards, and validity for frontier systems.
Mitchell Bryson AI Reliability Articles
Analysis of Google's interception of an AI-generated zero-day exploit and what divergent responses from OpenAI, Anthropic, and Microsoft mean for builders.
Mitchell Bryson AI Reliability Articles
In a single week, OpenAI killed Sora ($15M/day burn, $2.1M lifetime revenue), blindsided Disney on a $1B deal, shelved its adult chatbot, renamed its product org to 'AGI Deployment,' moved safety oversight away from the CEO, and bet everything on a model...
Mitchell Bryson AI Reliability Articles
Google launched tools to import your ChatGPT memories and chat histories. Apple is turning Siri into a marketplace where every AI assistant plugs in — for a 30% cut. OpenAI is wiring Codex into every work tool you touch. Shopify made every AI conversation a...
OpenAI Evaluation Filter
Learn how OpenAI’s Model Spec serves as a public framework for model behavior, balancing safety, user freedom, and accountability as AI systems advance.