Staff/Lead Data Scientist (Model Evaluation) - TikTok Integrity and Safety (San Jose)
Summary
Staff/Lead data scientist building LLM evaluation frameworks, metric systems, and statistical analysis for TikTok's Integrity and Safety team, focused on content safety, risk, and anomaly monitoring.
- Analyze experiment results and optimize experiment design
- Build LLM evaluation frameworks and metric systems
- Build monitoring and anomaly detection systems
- Collaborate on data science roadmaps and deliver data services
- Design metrics systems for content safety and risk
- Develop quantitative analysis systems for business challenges
- Evaluate security policy effectiveness using statistical methods
- Mentor team members and address skill gaps
- Use data mining to identify optimization opportunities