B
Product Analyst
Bolna
Bengaluru, India (Onsite)
≈ 116,3 тыс.–148,3 тыс. ₽ · 1,5 тыс.–1,9 тыс. $ · 1,3 тыс.–1,6 тыс. €
139 167 – 177 417 INR
🏢 Офис
Middle
Полная занятость
Продуктовая
Tech
Описание вакансии
Обязанности
•Analyze agent behavior and failure patterns
•Analyze routing latency and cost data
•Analyze self serve customer funnel
•Build LLM as judge evaluation pipelines
•Build dashboards and reporting scripts
•Compute WER and quality metrics
•Create and curate golden datasets
•Design and track evaluation metrics
•Evaluate ASR and transcript quality
•Generate cross customer call insights
•Perform inter rater reliability analysis
•Present findings to product ML and infra stakeholders
•Run LLM model benchmarking
•Run cohort and retention style analysis
Условия
•In-person collaboration
•Learning and development
•Professional development
Технологии: ASR Evaluation, Cohort Analysis, Cost analysis, Dashboards, Data Visualization, DeepEval, Funnel Analysis, Hypothesis Testing, Inter-rater reliability, Krippendorff Alpha, LLM Evaluation, LLM-as-judge, Latency analysis, Machine Learning, Machine Learning Benchmarking, Pandas, Python, Routing Analytics, SQL, Statistical Testing, Transliteration Normalization, WER