• Home
  • News
  • Research
  • Publication
  • Team
  • Teaching
  • Contact
    • 📌 2026 So Far — 11 Papers Accepted
    • 🎉 Three NeurIPS'26 Papers
    • 🎉 Three EMNLP Findings'26 Papers
    • 🧑‍⚖️ Area Chair
    • 🏆 Best Paper Award
    • 🧑‍⚖️ Area Chair
    • 🎉 Two ICML'26 Papers + One ICML'26 Workshop
    • 🎉 One ICLR'26 Paper
    • 🧑‍⚖️ Area Chair
    • 🎉 One NeurIPS'25 Workshop Paper
    • 🧑‍⚖️ Area Chair
    • 🎉 Two EMNLP Papers
    • 🏆 DARPA AIxCC Winner ($4M)!
    • 🏆 Best Paper Finalist
    • 🎉 One ICCV'25 Paper
    • 🎉 One DSN'25 Paper
    • 🏆 Graduate Fellowship
    • 🧑‍⚖️ Area Chair
    • 🏆 Best Paper Award
    • 🎉 2024 Summary
    • 🧑‍⚖️ Area Chair
    • 🎉 One NeurIPS'24 Paper (Spotlight)
    • 🎤 Invite Talk
    • 🎤 Breakout Session
    • 🏆 DARPA AIxCC Semifinals ($2M)
    • 🧑‍⚖️ Area Chair
    • 🎉 One NAACL'24 Paper
    • 🎉 One CVPR'24 Paper
    • 🎉 One ICLR'24 Paper
    • 🎉 Assistant Professor
    • 🏆 Best Paper Award
    • Which Preferences to Train On? End-to-End Multi-Objective Alignment with an Adversarial Preference Distribution
    • Online Conformal Abstention Under Adversarial Bandit Feedback
    • MJ: Multi-turn LLM Jailbreaking via Decomposed Credit Assignment
    • Transductive Generalization for GNNs via Optimal Transport
    • SAUL: Sharpness-Aware Augmented-Lagrangian Unlearning
    • The Interplay of Harness Design and Post-Training in LLM Agents
    • Can We Stop Malicious AI? KILLBENCH: A Benchmark for External AI Kill Switch Feasibility
    • The Illusion of Rust Safety: Detecting Modular Unsafe Functions with LLMs
    • Towards Functional Correctness of Large Code Models with Selective Generation
    • LLM Watermark Evasion via Bias Inversion
    • Ruby: Unmasking Unsafe Rust in Stripped Binaries via Machine Learning
    • Online Conformal Prediction with Adversarial Semi-bandit Feedback via Regret Minimization
    • ChronoBias: A Benchmark for Evaluating Time-conditional Group Bias in the Time-sensitive Knowledge of Large Language Models
    • Retrieval-Augmented Generation with Estimation of Source Reliability
    • Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearning
    • ATLANTIS: AI-driven Threat Localization, Analysis, and Triage Intelligence System
    • SOUNDBOOST: Effective RCA and Attack Detection for UAV via Acoustic Side-Channel
    • Selective Generation for Controllable Language Models
    • TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Prediction
    • MedBN: Robust Test Time Adaptation against Malicious Test Samples
    • PAC Prediction Sets Under Label Shift
    • Angelic Patches for Improving Third-Party Object Detector Performance
    • ACon$^2$: Adaptive Conformal Consensus for Provable Blockchain Oracles
    • CODiT: Conformal Out-of-Distribution Detection in Time-Series Data for Cyber-Physical Systems
    • PAC Prediction Sets for Meta-Learning
    • Sequential Covariate Shift Detection Using Classifier Two-Sample Tests
    • Towards PAC Multi-Object Detection and Tracking
    • PAC Prediction Sets Under Covariate Shift
    • PAC Confidence Predictions for Deep Neural Network Classifiers
    • iDECODe: In-distribution Equivariance for Conformal Out-of-distribution Detection
    • Calibrated prediction with covariate shift via unsupervised domain adaptation
    • PAC Confidence Sets for Deep Neural Networks via Calibrated Prediction
    • Resilient linear classification: an approach to deal with attacks on training data
    • Integrated intelligence for human-robot teams
    • Abnormal object detection by canonical scene-based contextual model
    • 📚 AI Security (2026 Spring)
    • 📚 Machine Learning (2025 Fall)
    • 📚 Trustworthy ML (2025 Spring)
    • 📚 Trustworthy ML (2024 Fall)
    • 📚 Discrete Mathematics (2024 Sring)
    • 📚 Trustworthy ML (2023 Fall)
    • Trustworthy Learning Theory
    • Agentic AI Alignment
    • Physical AI Safety
    • AI Red Teaming
  • Team

Which Preferences to Train On? End-to-End Multi-Objective Alignment with an Adversarial Preference Distribution

Minjae Lee
,
Kyunghyun Cho
,
Sangdon Park
2026
Last updated on Oct 4, 2026
Online Conformal Abstention Under Adversarial Bandit Feedback Sep 26, 2026 →