Athina帮助开发者监控和评估他们在生产环境中的LLMs应用程序。
立即设置监控并开始运行评估。
更多联系, 访问 the contact us page(https://cal.com/shiv-athina/30min)
Athina AI 公司名字: Athina AI .
Athina AI 价格链接: https://athina.ai/#pricing
Athina AI Linkedin链接: https://www.linkedin.com/company/athina-ai
Athina AI Github链接: https://github.com/athina-ai/athina-evals?utm_source=navbar&utm_medium=website
入门版
¥0/月
最多10,000推理次数,分析和洞察力
监控版
定制
包含入门版的所有功能,多个团队席位,主题分类,提示管理
评估版
定制
包含监控版的所有功能,自动评估,个性化支持
企业版
定制
定制评估套件,精细调整,SOC-2合规性,自托管部署
如需要最新的产品价格, 请访问这个链接查询最新价格: https://athina.ai/#pricing
社交媒体聆听
How to Use LLMs as Evaluators | TDE Workshop: Shiv Sakhuja
In this workshop, Shiv reviews LLM evaluators and how to use them for real-world applications. Shiv is a Co-founder @ Athina.ai (YC W23). Led by: Shiv Sakhuja Connect with Shiv LinkedIn: https://www.linkedin.com/in/shivsakhuja/ Athina AI: https://athina.ai/ Keep up with The Data Entrepreneurs! 🎥 YouTube: https://www.youtube.com/@TheDataEntrepreneurs 👉 Discord: https://discord.gg/RSqZbF9ygh 📰 Medium: https://medium.com/the-data-entrepreneurs 📅 Events: https://lu.ma/tde 🗞️ Newsletter: https://the-data-entrepreneurs.ck.page/profile Intro - 0:00 Athina AI - 1:30 Why do we need evals? - 2:28 Different types of evals - 5:20 Evaluation with labeled data - 7:10 Why LLMs can be used as evaluators - 9:34 Evaluation without labeled data - 12:54 Evaluating your retrieval - 19:16 Evaluating summaries - 22:47 Other evaluation techniques - 25:00 How to use evals in production - 25:38 Athina AI (SDK + Platform) - 26:38 Q&A - 28:26 Evals when starting from speech - 30:00 Cost and latency considerations - 34:09 Using "traditional" ML-based techniques - 37:21 Inference vs evaluation abilities of LLMs - 38:38 How to use these in CI/CD pipelines - 41:23
Why LLMs Can Do Evals (even if they failed at inference)
A clip from a recent workshop with Shiv Sakhuja, Co-founder at Athina AI (YC W23). Here, Shiv explains why an LLM that failed at inference can still be a good evaluator. 🎥 Full talk: https://youtu.be/JyocXRkiIcA Connect with Shiv LinkedIn: https://www.linkedin.com/in/shivsakhuja/ Athina AI: https://athina.ai/ Keep up with The Data Entrepreneurs! 🎥 YouTube: https://www.youtube.com/@TheDataEntrepreneurs 👉 Discord: https://discord.gg/RSqZbF9ygh 📰 Medium: https://medium.com/the-data-entrepreneurs 📅 Events: https://lu.ma/tde 🗞️ Newsletter: https://the-data-entrepreneurs.ck.page/profile
AI News for Jan 09, 2025
Welcome to 'The Automated Daily', your ultimate source for a streamlined and insightful daily news experience. Please support this podcast by checking out our sponsors: -Get $2,000 off the purchase of a Tesla product - https://ts.la/ron46932 Today's topics: -Stagehand web automation framework -VLC media player AI subtitles -Apple Intelligence scam concerns -Atelico AI Engine for gaming -Athina.ai workflow templates -Weco AI Functions platform -AI-generated code reliability issues -AI impact on global workforce -StoreLauncher Shopify store builder -Meta's AI character controversy -https://github.com/browserbase/stagehand -https://techcrunch.com/2025/01/09/vlc-tops-6-billion-downloads-previews-ai-generated-subtitles/ -https://www.crikey.com.au/2025/01/08/apple-new-artificial-intelligence-rewords-scam-messages-look-legitimate/ -https://atelico.studio/blog/cloud-ai-for-video-games-is-dead-on-arrival -https://app.athina.ai/flows/templates -https://www.aifunction.com/ -https://www.nuanced.dev/blog/the-reliability-gap -https://www.cnn.com/2025/01/08/business/ai-job-losses-by-2030-intl/index.html -https://storelauncher.app/ -https://www.washingtonpost.com/opinions/2025/01/08/meta-ai-bots-backlash-racist/ Subscribe to edition specific feeds: - Top news * Apple Podcast (https://apple.co/3PTvdUF) * Spotify (https://spoti.fi/3ZYXAW2) * RSS (https://bit.ly/the_automated_daily_news) - Tech news * Apple Podcast (https://apple.co/3RYWbg4) * Spotify (https://spoti.fi/3S089pG) * RSS (https://bit.ly/the_automated_daily_tech) - Hacker news * Apple Podcast (https://apple.co/48QWyzj) * Spotify (https://spoti.fi/45zD1kf) * RSS (https://bit.ly/the_automated_daily_hacker_news) - AI news * Apple Podcast (https://apple.co/3M6Tg1o) * Spotify (https://spoti.fi/3tzOfrz) * RSS (https://bit.ly/the_automated_daily_hackernews_ai) Visit our website at https://theautomateddaily.com/ Send feedback to feedback@theautomateddaily.com Youtube (https://www.youtube.com/@TheAutomatedDaily) LinkedIn (https://www.linkedin.com/in/the-automated-daily/) X (Twitter) (https://x.com/automated_daily)