Coval (YC S24) is a cutting-edge simulation and evaluation platform specifically designed for AI agents, drawing inspiration from methodologies used in the autonomous vehicle sector. This innovative app revolutionizes the testing process by automating evaluations for AI assistants across diverse modalities such as chat and voice. By streamlining the testing workflow, Coval empowers engineers to enhance test coverage and expedite the development cycle. It plays a crucial role in ensuring consistent performance of AI agents, tackling the inefficiencies and inaccuracies associated with manual testing. With Coval, developers can significantly improve the reliability of their AI systems, making it an indispensable tool for advancing AI technology.

Portkey is a powerful application designed to enhance the development and deployment of reliable, efficient, and high-performance applications. With its AI Gateway, it streamlines integration with artificial intelligence technologies, enabling teams to harness the power of advanced automation and intelligent features seamlessly. The Guardrails feature ensures robust security and compliance, providing peace of mind by enforcing best practices and protecting data integrity throughout the development lifecycle. Portkey's Observability Suite offers comprehensive monitoring and analytics, allowing teams to gain real-time insights into app performance and quickly address any issues. As a result, thousands of teams worldwide rely on Portkey to ship applications that meet high standards of quality while optimizing costs. Together, these features empower teams to accelerate their development processes and deliver exceptional software solutions consistently.

AgentOps is a robust Python SDK designed to streamline the process of AI agent monitoring and management. It provides comprehensive tools for tracking costs associated with large language models (LLMs), enabling users to maintain budget efficiency while leveraging advanced AI capabilities. The app excels in performance benchmarking, allowing developers and businesses to evaluate and optimize their AI deployments effectively. Integration is seamless with a variety of popular LLMs and agent frameworks, including CrewAI, Langchain, Autogen, AG2, and CamelAI, making it a versatile choice for diverse AI projects. With its user-friendly interface and powerful analytical features, AgentOps empowers users to harness the full potential of AI solutions while maintaining transparency and control over operational expenses. Ideal for developers and organizations seeking to enhance their AI workflows, AgentOps serves as a critical tool for both monitoring performance and managing costs efficiently.

Fiddler AI is a cutting-edge platform designed to enhance the operationalization of production machine learning (ML) models, generative AI (GenAI), and large language model (LLM) applications. It provides comprehensive monitoring and analytics capabilities that establish a common language and centralized controls, enabling seamless scalability and trust in AI deployments. A standout feature of the platform is the Fiddler Trust Service, which offers robust quality and moderation controls for LLM applications. With proprietary trust models that are cost-effective, task-specific, and scalable, Fiddler delivers industry-leading guardrails, available for cloud and VPC deployments to ensure security. Trusted by Fortune 500 companies, Fiddler AI facilitates the scaling of LLM and ML deployments to achieve high performance while reducing costs and ensuring responsible governance. For organizations looking to optimize their AI initiatives, Fiddler AI emerges as an essential tool.

Edwin AI is an advanced AI-driven solution designed specifically for IT Operations (ITOps). It aims to streamline incident investigation and resolution while minimizing operational noise prevalent in modern data centers. As an agentic AIOps product, Edwin AI excels in cross-domain alert correlation and root cause analysis, allowing IT teams to quickly identify and address issues. Its autonomous remediation features further enhance operational efficiency by resolving incidents without human intervention. By transforming IT operations, Edwin AI delivers a measurable impact: it significantly reduces alert fatigue, accelerates resolution times, and boosts overall productivity. Whether optimizing day-to-day operations or handling complex IT challenges, Edwin AI is crafted to be a reliable partner in modernizing and elevating IT infrastructure management.