Ïăœ¶ÊÓÆ”

Joelle Pineau

Ïăœ¶ÊÓÆ”

Headshot of Joelle Pineau

Prof. Joelle Pineau belongs to the School of Computer Science and is director of the Reasoning and Learning Lab at CIM.

Profile

2023

C.Y. Su, S. Zhou, E. Gonzalez-Kozlova, G. Butler-Laporte (
.) J. Pineau, V. Mooser, T. Marron, N.D. Beckmann, S. Kim-Schulze, A.W. Charney, S. Gnjatic, D.E. Kaufmann, M. Merard, J.B. Richards. “Circulating proteins to predict COVID-19 severity”. Scientific Reports 13 (1), 6236. 2023.

H. Satija, A. Lazaric, M. Pirotta, J. Pineau. “Group Fairness in Reinforcement Learning”. Transactions on Machine Learning Research. pp.1-60. 2023.

D.S. Sachan, M. Lewis, D. Yogatama, L. Zettlemoyer, J. Pineau, M. Zaheer. “Questions Are All You Need to Train a Dense Passage Retriever”. Transactions of the Association for Computational Linguistics 11, 600-616. 2023.

M.A. Legault, J. Hartford, M. Lu, A.Y. Yang, J. Pineau. “Evaluating machine learning instrumental variable methods to estimate conditional treatment effects in Mendelian randomization”. International Genetic Epidemiology Society. 2023.

P. Henderson, J. Hu, M. Diab, J. Pineau. “Rethinking Machine Learning Benchmarks in the Context of Professional Codes of Conduct”. Third ACM Symposium on Computer Science and Law (CSLAW 2024).

M. Wabartha, J. Pineau. “Piecewise Linear Parametrization of Policies: Towards Interpretable Deep Reinforcement Learning”. NeurIPS workshop on XAI in Action: Past, Present, and Future Applications. 2023.

2022

Madhulika Srikumar et al. “Advancing ethics review practices in AI research”. In: Nature Machine Intelligence 4.12 (2022), pp. 1061– 1064.

Devendra Singh Sachan et al. “Questions are all you need to train a dense passage retriever”. In: Transactions of the Association for Computational Linguistics 11 (2023), pp. 600–616.

Devendra Sachan et al. “Improving Passage Retrieval with Zero-Shot Question Generation”. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. 2022, pp. 3781–3797.

Bogdan Mazoure et al. “Low-Rank Representation of Reinforcement Learning Policies”. In: Journal of Artificial Intelligence Research 75 (2022), pp. 597–636.

GX-Chen Anthony et al. “A Generalized Bootstrap Target for Value-Learning, Efficiently Combining Value and Feature Predictions”. In: Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 36. 6. 2022, pp. 6829–6837.

Ekaterina Kochmar et al. “Automated datadriven generation of personalized pedagogical interventions in intelligent tutoring systems”. In: International Journal of Artificial Intelligence in Education 32.2 (2022), pp. 323–349.

Lucas Caccia et al. “New Insights on Reducing Abrupt Representation Change in Online Continual Learning”. In: International Conference on Learning Representations. 2021.

Martin Cousineau et al. “Estimating causal effects with optimization-based methods: A review and empirical comparison”. In: European Journal of Operational Research 304.2 (2023), pp. 367–380.

2021

J. Pineau, P. Vincent-Lamarre, K. Sinha, V. Lariviùre, A. Beygelzimer, F. D’Alche-Buc, E. Fox, and H. Larochelle. “Improving reproducibility in machine learning research: a report from the NeurIPS 2019 reproducibility program,” Journal of Machine Learning Research 22. 2021.p.1-20

E. Kochmar, D.D. Vu, R. Belfer, V. Gupta, I.V. Serban, and J. Pineau. “Automated Data-Driven Generation of Personalized Pedagogical Interventions in Intelligent Tutoring Systems,” International Journal of Artificial Intelligence in Education, 2021, 1-27

H. Satija, P.S. Thomas, J. Pineau, and R. Laroche. “Multi-Objective SPIBB: Seldonian Offline Policy Improvement with Safety Constraints in Finite MDPs,” Advances in Neural Information Processing Systems (NeurIPS) 2021

J. Lee, W. Jeon, B. Lee, J. Pineau, and K.E. Kim. “Optidice: Offline policy optimization via stationary distribution correction estimation,” International Conference on Machine Learning (ICML), 2021, 6120-6130

S. Sodhani, A. Zhang, and J. Pineau. “Multitask reinforcement learning with context-based representations,” International Conference on Machine Learning (ICML), 2021, 9767-9779

K. Sinha, P. Parthasarathi, J. Pineau, and A. Williams. “Unnatural language inference,” Annual Meeting of the Association for Computational Linguistics (ACL). 2021. Outstanding Paper Award.

P. Parthasarathi, J. Pineau, and S. Chandar. “Do Encoder Representations of Generative Dialogue Models have sufficient summary of the Information about the task?,” Special Interest Group on Discourse and Dialogue (SigDial). 2021.

P. Parthasarathi, M. Abdelsalam, J. Pineau, and S. Chandar. “A Brief Study on the Effects of Training Generative Dialogue Models with a Semantic loss,” Special Interest Group on Discourse and Dialogue (SigDial). 2021

J. Romoff, P. Henderson, D. Kanaa, E. Bengio, A. Touati, P.L. Bacon, and J. Pineau. “TDprop: Does Adaptive Optimization With Jacobi Preconditioning Help Temporal Difference Learning?,” International Conference on Autonomous Agents and MultiAgent Systems (AAMAS). 2021

P. Parthasarathi, K. Sinha, J. Pineau, and A. Williams. “Sometimes we want ungrammatical translations,” Conference on Empirical Methods in Natural Language Processing (EMNLP). 2021

K. Sinha, R. Jia, D. Hupkes, J. Pineau, A. Williams, and D. Kiela. “Order word matters pre-training for little,” Conference on Empirical Methods in Natural Language Processing (EMNLP). 2021

D. Jambor, K. Teru, J. Pineau, and W.L. Hamilton. “Exploring the Limits of Few-Shot Link Prediction in Knowledge Graphs,” European Chapter of the Association for Computational Linguistics (EACL). 2021.

S. Delacroix, J. Pineau, and J. Montgomery. “Democratising the digital revolution: the role of data governance,” Book chapter in Reflections on AI for Humanity, Braunschweig & Ghallab (eds.), Springer, 2021. 40-52. Accepted, to appear in 2022

M. Cousineau, V. Verter, S.A. Murphy, and J. Pineau. “Estimating Causal Effects with Optimization-Based Methods: A Review and Empirical Comparison,” European Journal of Operational Research 2022.

L. Caccia, R. Aljundi, N. Asadi, T. Tuytelaars, J. Pineau, and E. Belilovsky. “New Insights on Reducing Abrupt Representation Change in Online Continual Learning,” International Conference on Learning Representations 2022

A. GX-Chen, V. Chelu, B.A. Richards, and J. Pineau. “A Generalized Bootstrap Target for Value- Learning, Efficiently Combining Value and Feature Predictions,” American Associate for Artificial Page 44 CIM 2021 Annual Report CIM 2021 Annual Report Page 45 Intelligence (AAAI) 2021.

L. Caccia, R. Aljundi, N. Asadi, T. Tuytelaars, J. Pineau, and E. Belilovsky. “Reducing representation drift in online continual learning,” arXiv preprint arXiv:2104.05025

K. Bullard, D. Kiela, F. Meier, J. Pineau, and J. Foerster. “Quasi-equivalence discovery for zeroshot emergent communication,” arXiv preprint arXiv:2103.08067

C. Lyle, A. Zhang, M. Jiang, J. Pineau, and Y. Gal. “Resolving Causal Confusion in Reinforcement Learning via Robust Exploration,” Self-Supervision for Reinforcement Learning Workshop-ICLR 2021

M. Tomar, A. Zhang, R. Calandra, M.E. Taylor, and J. Pineau. “Model-invariant state abstractions for model-based reinforcement learning,” arXiv preprint arXiv:2102.09850

B. Li, V. François-Lavet, T. Doan, and J. Pineau. “Domain adversarial reinforcement learning,” arXiv preprint arXiv:2102.07097

A. Sriram, M. Muckley, K. Sinha, F. Shamout, J. Pineau, K.J. Geras, L. Azour, Y. Aphinyanaphongs, N. Yakubova, and W. Moore. “Covid-19 prognosis via self-supervised representation learning and multiimage prediction,” arXiv preprint arXiv:2101.04909

C.Y. Su, S. Zhou, E. Gonzalez-Kozlova, G. Butler- Laporte, (...) J. Pineau (...) and B. Richards. “Circulating proteins to predict adverse COVID-19 outcomes,” medRxiv. . org/10.1101/2021.10.04.21264015

2020

Benjamin Haibe-Kains, George Alexandru Adam, Ahmed Hosny, Farnoosh Khodakarami, MAQC Board, Levi Waldron, Bo Wang, Chris McIntosh, Anshul Kundaje, Casey S Greene, Michael M Hoffman, Jeffrey T Leek, Wolfgang Huber, Alvis Brazma, Joelle Pineau, Robert Tibshirani, Trevor Hastie, John Ioannidis, John Quackenbush, Hugo JWL Aerts. The importance of transparency and reproducibility in artificial intelligence research. Nature. 2020.

Nathan Peifer-Smadja, Redwan Maatoug, François-Xavier Lescure, Eric D’Ortenzio, Joelle Pineau and Jean-RĂ©mi King. Machine Learning for COVID-19 needs global collaboration and data-sharing. Nature Machine Intelligence. 2020.

Vincenzo Forgetta, Julyan Keller-Baruch, Marie Forest, Audrey Durand, Sahir Bhatnagar, John P Kemp, Maria Nethander, Daniel Evans, John A Morris, Douglas P Kiel, Fernando Rivadeneira, Helena Johansson, Nicholas C Harvey, Dan Mellström, Magnus Karlsson, Cyrus Cooper, David M Evans, Robert Clarke, John A Kanis, Eric Orwoll, Eugene V McCloskey, Claes Ohlsson, Joelle Pineau, William D Leslie, Celia MT Greenwood, J Brent Richards. Development of a polygenic risk score to improve screening for fracture risk: A genetic risk prediction study. PLoS medicine 17 (7). 2020.

Ximeng Mao, Joelle Pineau, Roy Keyes, Shirin A Enger. RapidBrachyDL: Rapid Radiation Dose Calculations in Brachytherapy via Deep Learning. International Journal of Radiation Oncology Biology Physics. 2020

Peter Henderson, Jieru Hu, Joshua Romoff, Emma Brunskill, Dan Jurafsky, Joelle Pineau. Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning. JMLR. 21(248), pp.1−43.

Koustuv Sinha, Joelle Pineau, Jessica Forde, Rosemary Nan Ke, Hugo Laorchelle. Neurips 2019 Reproducibility Challenge. A special issue of the journal ReScience C 6(2). 2020.

Clare Lyle, Amy Zhang, Angelos Filos, Shagun Sodhani, Marta Kwiatkowska, Yarin Gal, Doina Precup, Joelle Pineau. Invariant Causal Prediction for Block MDPs. ICML 2020.

Harsh Satija, Philip Amortila, Joelle Pineau. Constrained Markov Decision Processes via Backward Value Functions. ICML 2020.

Lucas Caccia, Eugene Belilovsky, Massimo Caccia, Joelle Pineau. Online Learned Continual Compression with Adaptive Quantization Module. ICML 2020.

Emmanuel Bengio, Joelle Pineau, Doina Precup. Interference and Generalization in Temporal Difference Learning. Submitted and accepted to ICML 2020.

Maxime Wabartha, Audrey Durand, Vincent François-Lavet, Joelle Pineau. Handling Black Swan Events in Deep Learning with Diversely Extrapolated Neural Networks. IJCAI 2020.

Ahmed Touati, Amy Zhang, Joelle Pineau, Pascal Vincent. Stable Policy Optimization via Off-Policy Divergence Regularization. UAI 2020.

Koustuv Sinha, Prasanna Parthasarathi, Jasmine Wang, Ryan Lowe, William L Hamilton, Joelle Pineau. Learning an Unreferenced Metric for Online Dialogue Evaluation. ACL 2020.

Ge Yang, Amy Zhang, Ari Morcos, Joelle Pineau, Pieter Abbeel, Roberto Calandra. Plan2Vec: Unsupervised Representation Learning by Latent Plans. Learning for Dynamics and Control (L4DC) 2020.

Iulian Vlad Serban, Varun Gupta, Ekaterina Kochmar, Dung D Vu, Robert Belfer, Joelle Pineau, Aaron Courville, Laurent Charlin, Yoshua Bengio. A Large-Scale, Open-Domain, Mixed-Interface Dialogue-Based ITS for STEM. AIED 2020.

Ekaterina Kochmar, Dung D Vu, Robert Belfer, Varun Gupta, Iulian V Serban, Joelle Pineau. Automated Personalized Feedback Improves Learning Gains in an Intelligent Tutoring System. AIED 2020.

R.Y. (David) Tao, Vincent Francois-Lavet, Joelle Pineau. Novelty Search in Representational Space for Sample Efficient Exploration. NeurIPS 2020. Oral presentation (1% of submissions).

Paul Barde, Julien Roy, Wonseok Jeon, Joelle Pineau, Chris Pal, Derek Nowrouzezahrai. Adversarial Soft Advantage Fitting: Imitation Learning without Policy Optimization. NeurIPS 2020. Spotlight presentation (4% of submissions).

2019

I.V. Serban, C. Sankar, M. Pieped, J. Pineau, Y. Bengio. “The Bottleneck Simulator: A Model-based Deep Reinforcement Learning Approach”. Journal of Machine Learning Research (JMLR). Accepted.

V. François-Lavet, G. Rabusseau, J. Pineau, D. Ernst, R. Fontaineau. “On Overfitting and Asymptotic Bias in Batch Reinforcement Learning with Partial Observability”. Journal of AI Research (JAIR). Vol.65. pp.1-30. 2019.

A.M.Froomkin, I. Kerr, J. Pineau. “When AIs outperform doctors: Confronting the challenges of a tort-induced over-reliance on machine learning”. Arizona Law Review, vol.61:33. 2019.

P. Paquette, Y. Lu, S. Bocco, M.O. Smith, S. Ortiz-Gagne, J. K. Kummerfeld, S. Singh, J. Pineau, A. Courville. “No Press Diplomacy: Modeling Multi-Agent Gameplay”. NeurIPS 2019.

M. Assran, J. Romoff, N. Ballas, J. Pineau, M. Rabbat. “Gossip-based Actor-Learner Architectures for Deep Reinforcement Learning”. NeurIPS 2019.

J. Romoff, P. Henderson, A. Touati, E. Brunskill, J. Pineau, Y. Ollivier, “Separable value functions across time-scales”. ICML 2019.

A. Das, T. Gervet, J. Romoff, D. Batra, D. Parikh, M. Rabbat, J. Pineau, “TarMAC: Targeted Multi-Agent Communication”. ICML 2019.

K. Sinha, S. Sodhani, J. Dong, J. Pineau, W. L. Hamilton. “CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Text”. EMNLP 2019.

B. Mazoure, T. Doan, A. Durand, R.D. Helm, J. Pineau. “Leveraging exploration in off-policy algorithms via normalizing flows”. CoRL 2019

L. Caccia, H. van Hoof, A. Courville, J. Pineau. “Deep Generative Modeling of LiDAR Data”. IROS 2019.

R. Lowe, J. Foerster, Y-L. Boureau, J. Pineau, Y. Dauphin. “On the Pitfalls of Measuring Emergent Communication”. AAMAS 2019.

J. Pineau, K. Sinha, G. Fried, R.N. Ke, H. Larochelle (guest editors). ReScience Journal, vol.5(2). Special Issue on the ICLR Reproducibility Challenge 2019.

2018

V. Francois-Lavet, P. Henderson, R. Islam, M. Bellemare, J. Pineau. "An Introduction to Deep Reinforcement Learning”. Foundations and Trends in Machine Learning. 11 (3-4). pp.219-354. 2018.

I. V. Serban, R. Lowe, P. Henderson, L. Charlin, J. Pineau. "A Survey of Available Corpora for Building Data-Driven Dialogue Systems: The Journal Version”. Dialogue & Discourse. 9 (1). pp.1-49. 2018.

A. Durand, O. Maillard, J. Pineau. "Streaming kernel regression with provably adaptive mean, variance, and regularization”. Journal of Machine Learning Research. 19. pp.1-34. 2018.

P. Henderson,R. Islam, P. Bachman, J. Pineau, D. Precup, D. Meger."Deep Reinforcement Learning that Matters”. AAAI. 7 pages. 2018.

P. Henderson, W-D. Chang, P.L. Bacon, D. Meger, J. Pineau, D. Precup. "OptionGAN: Learning Joint Reward-Policy Options using Generative Adversarial Inverse Reinforcement Learning”. AAAI. 7 pages. 2018.

P. Henderson, K. Sinha, N. Angelard-Gontier, N.R. Ke, G. Fried, R. Lowe, J. Pineau. "Ethical Challenges in Data-Driven Dialogue Systems”. AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society. 7 pages. 2018.

M. Smith, H. van Hoof, J. Pineau. "An Inference-Based Policy Gradient Method for Learning Options”. ICML. 8 pages. 2018.

A. Durand, C. Achilleos, D. Iacovides, K. Strati, T. Mitsis, J. Pineau. "Contextual Bandits for Adapting Treatment in a Mouse Model of de Novo Carcinogenesis”. Machine Learning for Healthcare. pp.67-82 2018.

P. Thodoro, A. Durand, J. Pineau, D. Precup. "Temporal Regularization for Markov Decision Processes”. NeurIPS (formerly NIPS). 8 pages. 2018.

P. Parthasarathi, J. Pineau. "Extending Neural Generative Conversational Model using External Knowledge Sources”. EMNLP. 6 pages. 2018.

J. Romo, P. Henderson, A. Piche, V. Francois-Lavet, J. Pineau. "Reward Estimation forVariance Reduction in Deep Reinforcement Learning”. International Conference on Robot Learning (CoRL). 11 pages. 2018.

P. Henderson, J. Romo, J. Pineau. "Where Did My OptimumGo?: An Empirical Analysis of Gradient Descent Optimization in Policy Gradient Methods”. EWRL. 2018.

A. Touati, H. Satija, J. Romo, J. Pineau, P. Vincent. "Randomized Value Functions via Multiplicative Normalizing Flows”. 8 pages. EWRL. 2018.

2017

M. Ghorbel, J. Pineau, R. Gourdeau, S. Javdani, S. Srinivasa. “A Decision-Theoretic Approach for the Collaborative Control of a Smart Wheelchair”. In. Journal of Social Robotics. pp. 1-15. 2017.

R. Lowe, N. Pow, I.V. Serban, L. Charlin, C-W. Liu J. Pineau. “Training end-to-end dialogue systems with the ubuntu dialogue corpus”. In. Dialogue & Discourse. pp. 31-65. 2017.

A. Emami, J El Youssef, R Rabasa-Lhoret, J Pineau, JR Castle, A Haidar. “Modeling Glucagon Action in Patients with Type 1 Diabetes”. IEEE journal of biomedical and health informatics 21 (4), 1163-1171. 2017.

W. Choi, O. Cyens, T. Chan, M. Schijven, S. Lajoie, M.E. Mancini, P. Dev, L. Fellander-Tsai, M. Ferland, P. Kato, J. Lau, M. Montonaro, J. Pineau, R. Aggarwal. “Engagement and Learning in Simulation: Recommendations of the Simnovate Engaged Learning Domain Group”. BMJ Simulation & Technology Enhanced Learning. 2017

R. Lowe, M. Noseworthy, I.V. Serban, N. Angelard-Gontier, E. Bengio, J. Pineau. “Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses”. Association for Computational Linguistics (ACL). 2017. Outstanding paper track (1.5% of submissions).

G. Rabusseau, B. Balle, J. Pineau. “Multitask Spectral Learning of Weighted Automata”. Neural Information Processing Systems (NIPS). 2017.

D. Bahdanau, P. Brakel, K. Xu, A. Goyal, R. Lowe, J. Pineau, A. Courville, Y. Bengio. “An Actor-Critic Algorithm for Sequence Prediction”. International Conference on Learning Representations (ICLR). 2017.

I.V. Serban, A. Sordoni, R. Lowe, L. Charlin, J. Pineau, A. Courville, Y. Bengio.“A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues”. Association for the Advancement of Artificial Intelligence (AAAI). 2017.

I.V. Serban, R. Lowe, L. Charlin, J. Pineau. “Generative Deep Neural Networks for Dialogue: A Short Review”. Empirical Methods in Natural Language Processing (EMNLP). 2017.

I.V. Serban, A.G. Ororbia II, J. Pineau, A. Courville. “Piecewise Latent Variables for Neural Variational Text Processing”. Empirical Methods in Natural Language Processing (EMNLP). 2017.

M. Noseworthy, J.C.K. Cheung, J. Pineau. “Predicting Success in Goal-Driven Human-Human Dialogues”. SIGdial Meeting on Discourse and Dialogue (SIGdial). 2017.

H.P. Truong, P. Parthasarathi, J. Pineau. “MACA: A Modular Architecture for Conversational Agents”. SIGdial Meeting on Discourse and Dialogue (SIGDIAL). 2017.

M. Smith, L. Charlin, J. Pineau. “A Sparse Probabilistic Model of User Preference Data”. Canadian Conference on Artificial Intelligence (CAIAC). 2017.

E. Bengio, V. Thomas, J. Pineau, D. Precup, Y. Bengio. “Independently Controllable Features” Reinforcement Learning and Decision Making (RLDM). arXiv: 1708.01289. 2017.

I.V. Serban, C. Sankar, M. Germain, S. Zhang, Z. Lin, S. Subramanian, T. Kim, M. Pieper, S. Chandar, N. Ke, S. Rajeswar, A. Brebisson, J.M.R. Sotelo, D. Suhubdy, V. Michalski, A. Nguyen, J. Pineau, Y. Bengio. “A Deep Reinforcement Learning Chatbot (Short Version)”. Neural Information Processing Systems (NIPS) Workshop on Conversational AI. 2017.

X. Cao, G. Rabusseau, J. Pineau. “Tensor Regression Networks with various Low-Rank Tensor Approximations. arXiv: 1712.09520. 2017.

A. Goyal, N.R. Ke, A. Lamb, C. Pal, J. Pineau, Y. Bengio. “ACtuAL: Actor-Critic Under Adversarial Learning” arXiv: 1711.04755. 2017.

A. Durand, O-A. Maillard, J. Pineau. “Streaming kernel regression with provably adaptive mean, variance, and regularization” arXiv: 1708.00768. 2017.

P. Henderson,R. Islam, P. Bachman, J. Pineau, D. Precup, D. Meger.“Deep Reinforcement Learning that Matters”. arXiv: 1709.06560. (Accepted at AAAI 2018.)

P. Henderson, W-D. Chang, P.L. Bacon, D. Meger, J. Pineau, D. Precup. “OptionGAN: Learning Joint Reward-Policy Options using Generative Adversarial Inverse Reinforcement Learning”. arXiv: 1709.06683. (Accepted at AAAI 2018.)

P. Henderson, K. Sinha, N. Angelard-Gontier, N.R. Ke, G. Fried, R. Lowe, J. Pineau. “Ethical Challenges in Data-Driven Dialogue Systems”. arXiv: 1711.09050. (Accepted at AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society. 2018.)

Back to top