> MALIS Home > MALIS Publications
MALIS Publications
 
MALIS Home
 
 

MALIS's publications
1 - 2 - 5 - [10] - 15
last years

- 2017 -

Conference Proceedings :

D.. SINGH, E. MERDIVAN, I.. PSYCHOULA, S.. HANKE, J.. KROPF, M. GEIST, A. HOLZINGER, "Human Activity Recognition using Recurrent Neural Networks". In Cross Domain Conference for Machine Learning and Knowledge Extraction (CD-MAKE), 2017. BibTex
A. MANUKYAN, M.A.. OLIVARES-MENDEZ, H. VOOS, M. GEIST, "Real time degradation identification of UAV using machine learning techniques". In International Conference on Unmanned Aircraft Systems (ICUAS'17), 2017. BibTex

Workshops :

M. GEIST, B. PIOT, O. PIETQUIN, "Faut-il minimiser le résidu de Bellman ou maximiser la valeur moyenne ?". In Journées Francophones sur la Planification, la Décision et l\'Apprentissage pour la conduite de systèmes (JFPDA), 2017. BibTex

- 2016 -

Regular Papers :

B. PIOT, M. GEIST, O. PIETQUIN, "Bridging the Gap between Imitation Learning and Inverse Reinforcement Learning". In IEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS), 2016. BibTex

Conference Proceedings :

B. PIOT, M. GEIST, O. PIETQUIN, "Batch Policy Iteration Algorithms for Continuous Domains". In European Workshop on Reinforcement Learning (EWRL), 2016. BibTex
J. PÉROLAT, B. PIOT, M. GEIST, B. SCHERRER, O. PIETQUIN, "Softened Approximate Policy Iteration for Markov Games". In International Conference on Machine Learning (ICML), 2016. BibTex
L. EL ASRI, B. PIOT, M. GEIST, R. LAROCHE, O. PIETQUIN, "Score-based Inverse Reinforcement Learning". In International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016), 2016. BibTex

Thesis :

M. GEIST, "Contrle optimal et apprentissage automatique, applications aux interactions homme-machine", Habilitation Diriger des Recherches, PhD Thesis, Universit de Lille 1, 2016. BibTex

Miscellaneous :

M. GEIST, B. PIOT, O. PIETQUIN, "Should one minimize the expected Bellman residual or maximize the mean value?", arxiv, 2016. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Difference of Convex Functions Programming Applied to Control with Expert Data", arxiv, 2016. BibTex

- 2015 -

Regular Papers :

B. SCHERRER, M. GEIST, "Recherche locale de politique dans un espace convexe". In Revue d'Intelligence Artificielle (RIA), 29(6):685-704, 2015. BibTex
M. GEIST, "Soft-max boosting". In Machine Learning, 100(2):305-332, (I discovered after publication that a very similar approach has been published some time ago, see "an iterative method for multi-class cost-sensitive learning" by Abe, Zadrozny and Langford, KDD'04), 2015. BibTex
B. SCHERRER, M. GHAVAMZADEH, V. GABILLON, B. LESNER, M. GEIST, "Approximate Modified Policy Iteration and its Application to the Game of Tetris". In Journal of Machine Learning Research, 16:1629-1676, 2015. BibTex

Conference Proceedings :

M. LAUFFER, F. GENTY, S. MARGUERON, J.L. COLLETTE, J.C. PIHAN, "Automatic recognition system of aquatic organisms by classical and fluorescence microscopy". In Proceedings of SPIE 9506, 9506(1O):1-7, Prague (République Tchèque), 2015. BibTex
S. ROSSIGNOL, "Technique d'assistance par le bruit pour aider l'oprateur de Teager-Kaiser suivre une composante frquentielle perturbe par du bruit". In GRETSI, 2015. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Imitation Learning Applied to Embodied Conversational Agents". In Machine Learning and Interactive Systems (MLIS), 2015. BibTex
M. GEIST, "A multiplicative UCB strategy for Gamma rewards". In European Workshop on Reinforcement Learning (EWRL), 2015. BibTex
T.. MUNZER, B. PIOT, M. GEIST, O. PIETQUIN, M.. LOPES, " Inverse Reinforcement Learning in Relational Domains". In International Joint Conferences on Artificial Intelligence (IJCAI), (to appear), 2015. BibTex

- 2014 -

Regular Papers :

H. FREZZA-BUET, "Online Computing of Non-Stationary Distributions Velocity Fields by an Accuracy Controlled Growing Neural Gas". In Neural Networks, 60:203--221, 2014. BibTex
M. GEIST, B. SCHERRER, "Off-policy Learning with Eligibility Traces: A Survey". In Journal of Machine Learning Research (JMLR), 15:289-333, 2014. BibTex
N. FRESSENGEAS, H. FREZZA-BUET, "Cellular Computing and Least Squares for partial differential problems parallel solving". In Journal of Cellular Auromata, 9(1):1-21, 2014. BibTex

Conference Proceedings :

M. LAUFFER, F. GENTY, S. MARGUERON, J.L. COLLETTE, A. LEVEY, Y. HOUZELLE, J.C. PIHAN, "Fluorescence imaging of plant pigments for automatical recognition of aquatic organisms". In Proceedings of the XII Conference on Optical Chemical Sensors and Biosensors:FS-29, Athens (Grèce), 2014. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Difference of Convex Functions Programming for Reinforcement Learning". In Advances in Neural Information Processing Systems (NIPS 2014), 2014. BibTex
B. PIOT, O. PIETQUIN, M. GEIST, "Predicting when to laugh with structured classification". In Annual Conference of the International Speech Communication Association (InterSpeech), 2014. BibTex
B. SCHERRER, M. GEIST, "Local Policy Search in a Convex Space and Conservative Policy Iteration as Boosted Policy Search". In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), (to appear), 2014. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Boosted Bellman Residual Minimization Handling Expert Demonstrations". In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), Springer, (to appear), 2014. BibTex
J. FIX, "Dynamic formation of self-organizing maps". In 10th workshop on Self-Organizing Maps, WSOM 2014, 2014. BibTex
D. BAHEUX, H. FREZZA-BUET, J. FIX, "Towards an effective multi-map self organizing recurrent neuronal network". In Proc. ESANN, 2014. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Boosted and Reward-regularized Classification for Apprenticeship Learning". In 13th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), Paris, France, (accepted, to appear), 2014. BibTex

Thesis :

B. KHOUZAM, "Neural Networks as Cellular Computing Models for Temporal Sequence Porcessing", PhD Thesis, Suplec, 2014. BibTex

Workshops :

B. PIOT, M. GEIST, O. PIETQUIN, "Mthode de minimisation du rsidu de Bellman booste qui tient compte des dmonstrations expertes". In Journes Francophone de Plannification, Dcision et Apprentissage (JFPDA), 2014. BibTex
B. SCHERRER, M. GEIST, "Quand l'optimalit locale implique une garantie globale : recherche locale de politique dans un espace convexe et algorithme d'itration sur les politiques conservatif vu comme une monte de gradient ". In Journes Francophone de Plannification, Dcision et Apprentissage (JFPDA), 2014. BibTex

- 2013 -

Regular Papers :

J. FIX, "Template based black-box optimization of dynamic neural fields". In Neural Networks, 46:40--49, 2013. BibTex
H. FREZZA-BUET, M. GEIST, "A C++ Template-Based Reinforcement Learning Library: Fitting the Code to the Mathematics". In Journal of Machine Learning Research, 14:625 - 628, 2013. BibTex
M. GEIST, O. PIETQUIN, "Algorithmic Survey of Parametric Value Function Approximation". In IEEE Transactions on Neural Networks and Learning Systems, 24(6):845 - 867, pdf, 2013. BibTex
E. KLEIN, B. PIOT, M. GEIST, O. PIETQUIN, "Classification structure pour l'apprentissage par renforcement inverse". In Revue d'Intelligence Artificielle, 27(2/2013):155-170, pdf, 2013. BibTex
B. KHOUZAM, H. FREZZA-BUET, "Distributed Recurrent Self-Organization for Tracking the State of Non-Stationary Partially Observable Dynamical Systems". In Biologically Inspired Cognitive Architectures, 3:87--104, 2013. BibTex
O. PIETQUIN, H. HASTIE, "A survey on metrics for the evaluation of user simulations". In Knowledge Engineering Review, 28(01):59-73, first published as FirstView, 2013. BibTex

Conference Proceedings :

L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Model-free POMDP optimisation of tutoring systems with echo-state networks". In Proceedings of the 14th SIGDial Meeting on Discourse and Dialogue (SIGDial 2013):102-106, Metz (France), 2013. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Learning from demonstrations: Is it worth estimating a reward function?". In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD 2013), Blockeel, Hendrik and Kersting, Kristian and Nijssen, Siegfried and Zelezny, Filip, ISBN: 978-3-642-40987-5, Springer, Lecture Notes in Computer Science, 8188:17-32, Prague (Czech Republic) , 2013. BibTex
E. KLEIN, B. PIOT, M. GEIST, O. PIETQUIN, "A cascaded supervised learning approach to inverse reinforcement learning". In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD 2013), Blockeel, Hendrik and Kersting, Kristian and Nijssen, Siegfried and Zelezny, Filip, ISBN: 978-3-642-40987-5, Springer, Lecture Notes in Computer Science, 8188:1-16, Prague (Czech Republic) , 2013. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Particle Swarm Optimisation of Spoken Dialogue System Strategies". In Proceedings of the 14th Annual Conference of the International Speech Communication Association (Interspeech 2013), Lyon (France), 2013. BibTex
L. EL ASRI, R. LAROCHE, O. PIETQUIN, "Reward Shaping For Statistical Optimisation Of Dialogue Management". In Proceedings of the International Conference on Statistical Language and Speech Processing (SLSP 2013), Dediu, Adrian-Horia and Martin-Vide, Carlos and Mitkov, Ruslan and Truthe, Bianca, ISBN: 978-3-642-39592-5, Springer, Lecture Notes in Computer Science , 7978:93-101, Tarragona (Spain), 2013. BibTex
O. PIETQUIN, "Inverse Reinforcement Learning for Interactive Systems". In Proceedings of the IJCAI workshop on Machine Learning for Interactive Systems (MLIS 2013), Beijing (China), Invited Speaker, 2013. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Random Projections: a Remedy for Overfitting Issues in Time Series Prediction with Echo State Networks". In Proceedings of the 38th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2013), Vancouver, Canada, to appear, 2013. BibTex
R. NIEWIADOMSKI, J. HOFMANN, J. URBAIN, T. PLATT, J. WAGNER, B. PIOT, H. CAKMAK, S. PAMMI, T. BAUR, S. DUPONT, M. GEIST, F. LINGENFELSER, G. MCKEOWN, O. PIETQUIN, W. RUCH, "Laugh-aware virtual agent and its impact on user amusement ". In Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems (AAMAS2013):619-626, Saint Paul, USA, 2013. BibTex

Proceedings :

M. ESKENAZI, M. STRUBE, B. DI EUGENIO, J. WILLIAMS, O. PIETQUIN, "14th annual SIGdial Meeting on Discourse and Dialogue ", 2013. BibTex

Technical Reports :

M. GEIST, B. SCHERRER, "Off-policy Learning with Eligibility Traces: A Survey", Suplec - INRIA, 2013. BibTex

Patents :

J. OSTER, G. CLIFFORD, O. PIETQUIN, M. GEIST, "Periodic Artifact Reduction from Biomedical Signals", patent WO2013052944, 2013. BibTex

Workshops :

B. PIOT, M. GEIST, O. PIETQUIN, "Classification rgularise par la rcompense pour l'Apprentissage par Imitation". In Journes Francophones de Plannification, Dcision et Apprentissage (JFPDA), Lille (FRANCE), 2013. BibTex
M. GEIST, E. KLEIN, B. PIOT, Y. GUERMEUR, O. PIETQUIN, "Around Inverse Reinforcement Learning and Score-based Classification". In 1st Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2013), Princeton (USA), 2013. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Learning from demonstrations: Is it worth estimating a reward function?". In 1st Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2013), Princeton, USA, 2013. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Optimisation par essaims particulaires de stratgies de dialogue". In Journes Francophones de Plannification, Dcision et Apprentissage (JFPDA), 2013. BibTex
E. KLEIN, B. PIOT, M. GEIST, O. PIETQUIN, "Apprentissage par renforcement inverse en cascadant classification et rgression". In Journes Francophones de Plannification, Dcision et Apprentissage (JFPDA), 2013. BibTex
B. PIOT, M. GEIST, O. PIETQUIN, "Apprentissage par dmonstrations : vaut-il la peine d'estimer une fonction de rcompense?". In Journes Francophones de Plannification, Dcision et Apprentissage (JFPDA), 2013. BibTex

- 2012 -

Regular Papers :

J. WILLIAMS, K. YU, B. CHAIB DRAA, O. LEMON, R. PIERACCINI, O. PIETQUIN, P. POUPART, S. YOUNG, "Introduction to the Issue on Advances in Spoken Dialogue Systems and Mobile Interface". In IEEE Journal of Selected Topics in Signal Processing, 6(8):889 - 890, 2012. BibTex
L. DAUBIGNEY, M. GEIST, S. CHANDRAMOHAN, O. PIETQUIN, "A Comprehensive Reinforcement Learning Framework for Dialogue Management Optimisation". In IEEE Journal of Selected Topics in Signal Processing, ISBN: 1932-4553, 6(8):891-902, pdf, 2012. BibTex
J. FIX, N. ROUGIER, "DANA: Distributed numerical and adaptive modelling framework". In Network: Computation in Neural Systems:1-17, 2012. BibTex

Conference Proceedings :

F. PENNERATH, "L'extraction de rgles de dpendance bien dfinies entre ensembles de variables multivalues". In Extraction et gestion des connaissances (EGC'2012), Actes, janvier 31 - fvrier 2012, Bordeaux, France, Yves Lechevallier and Guy Melanon and Bruno Pinaud, ISBN: 978-2-70568-310-8, Revue des Nouvelles Technologies de l'Information, RNTI-E-23:249-254, Hermann-Editions, 2012. BibTex
S. CHANDRAMOHAN, M. GEIST, F. LEFVRE, O. PIETQUIN, "Co-adaptation in Spoken Dialogue Systems". In Proceedings of the Fourth International Workshop on Spoken Dialog Systems (IWSDS 2012), Paris (France), 2012. BibTex
E. KLEIN, M. GEIST, B. PIOT, O. PIETQUIN, "Inverse Reinforcement Learning through Structured Classification". In Advances in Neural Information Processing Systems (NIPS 2012), Lake Tahoe (NV, USA), 2012. BibTex
S. CHANDRAMOHAN, M. GEIST, F. LEFVRE, O. PIETQUIN, "Behavior Specific User Simulation in Spoken Dialogue Systems". In Proceedings of the 10th ITG Conference on Speech Communication:1 - 4, Braunschweig (Germany), http://www.metz.supelec.fr/~geist_mat/pdfs/Supelec792.pdf, 2012. BibTex
L. EL ASRI, R. LAROCHE, O. PIETQUIN, "Reward Function Learning for Dialogue Management". In Proceedings of the sixth Starting Artificial Intelligence Research Symposium (STAIRS 2012):95 - 106, Montpellier (France), 2012. BibTex
O. PIETQUIN, F. TANGO, "A Reinforcement Learning Approach to Optimize the longitudinal Behavior of a Partial Autonomous Driving Assistance System ". In Proceedings of the European Conference on Artificial Intelligence (ECAI 2012) and the seventh Conference on Prestigious Applications of Intelligent Systems (PAIS 2012):987 - 992, Montpellier (France), Best Paper Award, 2012. BibTex
B. SCHERRER, V. GABILLON, M. GHAVAMZADEH, M. GEIST, "Approximate Modified Policy Iteration". In International Conference on Machine Learning (ICML), (to appear), 2012. BibTex
M. GEIST, B. SCHERRER, A. LAZARIC, M. GHAVAMZADEH, "A Dantzig Selector Approach to Temporal Difference Learning". In International Conference on Machine Learning (ICML), (to appear), 2012. BibTex
O. PIETQUIN, "Statistical User Simulation for Spoken Dialogue Systems: What for, Which Data, Which Future? ". In Proceedings of the NAACL-HLT 2012 Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data (SDCTD 2012):9-10, Montral (Canada), Invited position paper, 2012. BibTex
J. OSTER, M. GEIST, O. PIETQUIN, G. CLIFFORD, "Filtering of pathological ventricular rhythms during MRI scanning". In Proceedings of the seventh International Workshop on Biosignal Interpretation, Como (Italy), 2012. BibTex
E. KLEIN, B. PIOT, M. GEIST, O. PIETQUIN, "Classification structure pour lapprentissage par renforcement inverse". In Actes de la Confrence Francophone sur l'Apprentissage Automatique (Cap 2012):1-16, Nancy, France, 2012. BibTex
J. FIX, M. GEIST, "Optimisation de contrleurs par essaim de particules". In Actes de la Confrence Francophone sur l'Apprentissage Automatique (Cap 2012):1-14, Nancy, France, 2012. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Optimisation d'un tuteur intelligent partir d'un jeu de donnes fix". In Actes des Journes d'Etudes de la Parole (JEP 2012):241-248, Grenoble (France), 2012. BibTex
S. CHANDRAMOHAN, M. GEIST, F. LEFVRE, O. PIETQUIN, "Clustering Behaviors Of Spoken Dialogue Systems Users". In Proceedings of the 37th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2012), IEEE:4981 - 4984, Kyoto (Japan), 2012. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Off-policy Learning in Large-scale POMDP-based Dialogue Systems". In Proceedings of the 37th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2012), IEEE:4989 - 4992, Kyoto (Japan), 2012. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Apprentissage off-policy appliqu un systme de dialogue bas sur les PDMPO". In Actes du 18me congrs francophone sur la Reconnaissance de Formes et l'Intelligence Artificielle (RFIA 2012), Lyon (France), 2012. BibTex

Book Chapters :

S. KEIZER, S. ROSSIGNOL, S. CHANDRAMOHAN, O. PIETQUIN, "User Simulation in the Development of Statistical Spoken Dialogue Systems". In Data-Driven Methods for Adaptive Spoken Dialogue Systems: Computational Learning for Conversational Interfaces, Oliver Lemon - Olivier Pietquin, ISBN: 978-1461448020, Springer, 4:39-73, 2012. BibTex
J. FIX, M. GEIST, "Monte-Carlo Swarm Policy Search". In Symposium on Swarm Intelligence and Differential Evolution, Springer Verlag - Heidelberg Berlin, Lecture Notes in Artificial Intelligence (LNAI):9 pages, Zakopane (Poland), 2012. BibTex
J. GUSTEDT, S. VIALLE, H. FREZZA-BUET, D. BOUMBA SITOU, N. FRESSENGEAS, J. FIX, "InterCell: a Software Suite for Rapid Prototyping and Parallel Execution of Fine Grained Applications". In Applied Parallel and Scientific Computing, 10th International Conference, PARA 2010, Proceedings, Part I, Kristjn Jnasson (Ed), Springer, Heidelberg, LNCS, 7133, Extended and selected paper of PARA 2010 conference, 11 pages, 2012. BibTex

Proceedings :

O. PIETQUIN, J. FIX, M. GEIST, "Proceedings of the 8th eNTERFACE workshop", Metz (France), 2012. BibTex

Books :

O. LEMON, O. PIETQUIN, "Data-Driven Methods for Adaptive Spoken Dialogue Systems: Computational Learning for Conversational Interfaces ", Oliver Lemon - Olivier Pietquin, ISBN: 978-1461448020, Springer, 177 pages, 2012. BibTex

Thesis :

S. CHANDRAMOHAN, "Revisiting User Simulation in Dialogue Systems: Do we still need them? Will imitation play the role of simulation?", PhD Thesis, University of Avignon, PhD Thesis in Computer Science, 2012. BibTex

Miscellaneous :

K. YU, J. WILLIAMS, B. CHAIB DRAA, O. LEMON, R. PIERACCINI, O. PIETQUIN, P. POUPART, S. YOUNG, "IEEE Journal on Selected Topics in Signal Processing : special issue on Advances in Spoken Dialogue Systems and Mobile Interfaces", 2012. BibTex

Workshops :

E. KLEIN, B. PIOT, M. GEIST, O. PIETQUIN, "Structured Classification for Inverse Reinforcement Learning". In European Workshop on Reinforcement Learning (EWRL 2012), Edinburgh (UK), 2012. BibTex
M. GEIST, B. SCHERRER, A. LAZARIC, M. GHAVAMZADEH, "Un slecteur de Dantzig pour l'apprentissage par diffrences temporelles". In Journes Francophones sur la Planification, la Dcision et l'Apprentissage pour la conduite des systmes (JFPDA), 2012. BibTex
B. SCHERRER, V. GABILLON, M. GHAVAMZADEH, M. GEIST, "Approximations de l'algorithme Itrations sur les Politiques Modifi". In Journes Francophones sur la Planification, la Dcision et l'Apprentissage pour la conduite des systmes (JFPDA), 2012. BibTex
S. CHANDRAMOHAN, M. GEIST, F. LEFVRE, O. PIETQUIN, "Regroupement non-supervis d'utilisateurs par leur comportement pour les systmes de dialogue parl". In Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2012), Nancy (France), 2012. BibTex

- 2011 -

Regular Papers :

O. LEMON, O. PIETQUIN, "Introduction to Special Issue on Machine Learning for Adaptivity in Spoken Dialogue Systems". In ACM Transactions on Speech and Language Processing, 7(3), 2011. BibTex
O. PIETQUIN, M. GEIST, S. CHANDRAMOHAN, H. FREZZA-BUET, "Sample-Efficient Batch Reinforcement Learning for Dialogue Management Optimization". In ACM Transactions on Speech and Language Processing, 7(3):7:1-7:21, 2011. BibTex
B. CHEVAILLIER, D. MANDRY, J.L. COLLETTE, M. CLAUDON, M.A. GALLOY, O. PIETQUIN, "Functional segmentation of renal DCE-MRI sequences using vector quantization algorithms". In Neural Processing Letters, ISBN: 1370-4621, 34(1):71-85, 2011. BibTex
L. ALECU, H. FREZZA-BUET, F. ALEXANDRE, "Can self-organization emerge through dynamic neural fields computation? ". In Connection Science, 23(1):1-31, 2011. BibTex

Conference Proceedings :

M. GEIST, O. PIETQUIN, "Kalman filtering & colored noises: the (autoregressive) moving-average case". In Proceedings of the IEEE Workshop on Machine Learning Algorithms, Systems and Applications (MLASA 2011):4 pages, Honolulu (USA), 2011. BibTex
E. KLEIN, M. GEIST, O. PIETQUIN, "Reducing the dimentionality of the reward space in the Inverse Reinforcement Learning problem". In Proceedings of the IEEE Workshop on Machine Learning Algorithms, Systems and Applications (MLASA 2011):4 pages, Honolulu (USA), 2011. BibTex
H. GLAUDE, F. AKRIMI, M. GEIST, O. PIETQUIN, "A Non-Parametric Approach to Approximate Dynamic Programming". In Proceedings of the 10th IEEE International Conference on Machine Learning and Applications (ICMLA 2011):317-322, Honolulu (USA), 2011. BibTex
B. KHOUZAM, H. FREZZA-BUET, "Tracking Non-stationary Dynamical System Phase using Multi-map and Temporal Self-organizing Architecture". In NaBIC 2011, IEEE, Salamanca (Spain), 2011. BibTex
B. KHOUZAM, H. FREZZA-BUET, "Discovering the phase of a dynamical system from a stream of partial observations with a multi-map self-organizing architecture". In COGNITIVE 2011, Rome (Italy), 2011. BibTex
S. ROSSIGNOL, M. IANOTTO, O. PIETQUIN, "Training a BN-based user model for dialogue simulation with missing data". In Proceedings of the International Joint Conference on Natural Language Processing (IJCNLP 2011), ACLWeb:598-604, Chiang Mai (Thailand), 2011. BibTex
O. PIETQUIN, L. DAUBIGNEY, M. GEIST, "Optimisation of a Tutoring System from a Fixed Set of Data". In Proceedings of the ISCA workshop on Speech and Language Technology in Education (SLaTE 2011), Venice (Italy), 2011. BibTex
S. MENETRE, J.P. DIDON, O. PIETQUIN, C. DE CHILLOU, J. FELBLINGER, "Within-Patient Correlation Influence on Defibrillation Outcome Prediction using a Bayesian Classifier". In Proceedings of the 38th Annual Scientific Conference of Computing in Cardiology (CinC 2011), Hangzhou (China), 2011. BibTex
L. DAUBIGNEY, M. GASIC, S. CHANDRAMOHAN, M. GEIST, O. PIETQUIN, S. YOUNG, "Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system". In Proceedings of 12th Annual Conference of the International Speech Communication Association (Interspeech 2011):1301-1304, Florence (Italy), 2011. BibTex
S. CHANDRAMOHAN, M. GEIST, F. LEFVRE, O. PIETQUIN, "User Simulation in Dialogue Systems using Inverse Reinforcement Learning". In Proceedings of the 12th Annual Conference of the International Speech Communication Association (Interspeech 2011):1025-1028, Florence (Italy), 2011. BibTex
S. ROSSIGNOL, O. PIETQUIN, "Comparaison de mesures de voisement/non-voisement dans les signaux de parole". In Actes du coloque du Groupement de Recherche en Traitement du Signal et des Images (GRETSI 2011), Bordeaux (France), 2011. BibTex
R. CHOU, Y. BOERS, M. PODT, M. GEIST, "Performance Evaluation for Particle Filters". In 14th International Conference on Information Fusion (FUSION 2011), IEEE:7 pages, Chicago, USA, 2011. BibTex
O. PIETQUIN, M. GEIST, S. CHANDRAMOHAN, "Sample Efficient On-line Learning of Optimal Dialogue Policies with Kalman Temporal Differences". In International Joint Conference on Artificial Intelligence (IJCAI 2011):1878-1883, Barcelona, Spain, Oral Presentation, 2011. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Apprentissage par renforcement pour la personnalisation dun logiciel denseignement des langues". In Actes de la Confrence sur les Environnements Informatiques pour lApprentissage Humain (EIAH 2011), Mons (Belgium), 4 pages, 2011. BibTex
L. DAUBIGNEY, O. PIETQUIN, "Single-pass P300 detection with Kalman filtering and SVMs". In Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2011):399-404, Bruges (Belgium), 2011. BibTex
J. FIX, M. GEIST, O. PIETQUIN, H. FREZZA-BUET, "Dynamic Neural Field Optimization using the Unscented Kalman Filter". In Proceedings of the IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB 2011), ISBN: 978-1-4244-9890-1, IEEE:1 - 7, Paris (France), 2011. BibTex
M. GEIST, O. PIETQUIN, "Parametric Value Function Approximation: a Unified View". In Proceedings of the IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2011):9-16, Paris (France), 2011. BibTex
O. PIETQUIN, F. TANGO, R. ARAS, "Batch Reinforcement Learning for Optimizing Longitudinal Driving Assistance Strategies". In Proceedings of the IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS 2011):73 - 79, Paris (France), 2011. BibTex
M. GEIST, O. PIETQUIN, "Managing Uncertainty within the KTD Framework". In Proceedings of the Workshop on Active Learning and Experimental Design (AL&E collocated with AISTAT 2010), Journal of Machine Learning Research Conference and Workshop Proceedings:157-168, Sardinia (Italy), 2011. BibTex

Book Chapters :

M. GEIST, B. SCHERRER, "L1-penalized projected Bellman residual". In Proceedings of the European Workshop on Reinforcement Learning (EWRL 2011), Springer Verlag - Heidelberg Berlin, Lecture Notes in Computer Science (LNCS):12 pages, Athens (Greece), 2011. BibTex
E. KLEIN, M. GEIST, O. PIETQUIN, "Batch, Off-policy and Model-free Apprenticeship Learning". In Proceedings of the European Workshop on Reinforcement Learning (EWRL 2011), Springer Verlag - Heidelberg Berlin, Lecture Notes in Computer Science (LNCS):12 pages, Athens (Greece), 2011. BibTex
B. SCHERRER, M. GEIST, "Recursive Least-Squares Learning with Eligibility Traces". In Proceedings of the European Workshop on Machine Learning (EWRL 2011), Springer Verlag - Heidelberg Berlin, Lecture Notes in Computer Science (LNCS):12 pages, Athens (Greece), 2011. BibTex
F. TANGO, L. MININ, R. ARAS, O. PIETQUIN, "Automation Effects on Driver's Behaviour when integrating a PADAS and a Distraction Classifier". In Digital Human Modeling, Vincent Duffy, Springer, Lecture Notes in Computer Science, 6777:503-512, Orlando (FL, USA), Proceedings of the Intenational Conference on Human-Computer Interfaces (HCI 2011), 2011. BibTex
F. TANGO, M. ALONSO, M.H. VEGA, R. ARAS, O. PIETQUIN, "A Reinforcement Learning approach for designing and optimizing interaction strategies for a Human-Machine Interface of a Partially Autonomous Driver Assistance System". In Human Modelling in Assisted Transportation: Models, Tools and Risk Methods, P.C Cacciabue and M. Hjlmdahl and A. Luedtke and C. Riccioli, Springer Verlag, Heidelberg - Berlin:353-362, Belgirate (Italy), Proceedings of the Workshop on Human Modelling in Assisted Transportation (HMAT 2010), 2011. BibTex
F. TANGO, R. ARAS, O. PIETQUIN, "Learning Optimal Control Strategies from Interactions for a Partially Autonomous Driver Assistance System". In Human Modelling in Assisted Transportation: Models, Tools and Risk Methods, P.C Cacciabue and M. Hjlmdahl and A. Luedtke and C. Riccioli, Springer Verlag, Heidelberg - Berlin:119-128, Belgirate (Italy), Proceedings of the Workshop on Human Modelling in Assisted Transportation (HMAT 2010), 2011. BibTex

Thesis :

H. FREZZA-BUET, "Un calcul cortical pour les systmes situs", Habilitation Diriger les Recherches, PhD Thesis, Universit Nancy II, 2011. BibTex
O. PIETQUIN, "De l'apprentissage statistique pour le contrle optimal et le traitement du signal - Contribution la prise en compte de l'humain dans les systmes intelligents", Habilitation Diriger des Recherches, PhD Thesis, Universit Paul Sabatier de Toulouse (Toulouse III), 2011. BibTex

Technical Reports :

F. JURCICEK, M. GASIC, S. YOUNG, G. PUTOIS, R. LAROCHE, M. GEIST, O. PIETQUIN, "Online adaptation of dialogue systems" (1.5), CLASSiC Project Deliverable, 2011. BibTex
O. PIETQUIN, H. HASTIE, S. JANARTHANAM, S. KEIZER, G. PUTOIS, L. VAN DER PLAS, "Annotated Data Archive" (6.5), CLASSiC Project Deliverable, 2011. BibTex
S. ROSSIGNOL, S. JANARTHANAM, X. LIU, O. PIETQUIN, M. IANOTTO, "User simulations of different types of Appointment Scheduling and Self-Help user" (3.6), CLASSiC Project Deliverable, 2011. BibTex

Miscellaneous :

O. PIETQUIN, S. DUPONT, "Incorporating Laughter into Human-Avatar Interactions: Research and Evaluation - The ILHAIRE project", IEEE SLTC News Letter, 2011. BibTex
O. LEMON, O. PIETQUIN, "Special Issue of the ACM Transaction on Speech and Language Technologies on Machine Learning for Robust and Adaptive Spoken Dialogue Systems", 2011. BibTex

Workshops :

M. GEIST, B. SCHERRER, "Moindres carrs rcursifs pour l'valuation off-policy d'une politique avec traces d'ligibilit". In Siximes Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2011):22 pages, Rouen (France), 2011. BibTex
E. KLEIN, M. GEIST, O. PIETQUIN, "Apprentissage par imitation tendu au cas batch, off-policy et sans modle". In Siximes Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2011):9 pages, Rouen (France), 2011. BibTex
L. DAUBIGNEY, M. GEIST, O. PIETQUIN, "Gestion de lincertitude pour loptimisation en ligne dun gestionnaire de dialogues parls grande chelle bas sur les POMDP". In Siximes Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2011):7 pages, Rouen (France), 2011. BibTex
S. CHANDRAMOHAN, M. GEIST, O. PIETQUIN, "Apprentissage par Renforcement Inverse pour la Simulation d'Utilisateurs dans les Systmes de Dialogue". In Siximes Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2011):7 pages, Rouen (France), 2011. BibTex
E. KLEIN, M. GEIST, O. PIETQUIN, "Batch, Off-policy and Model-Free Apprenticeship Learning". In IJCAI Workshop on Agents Learning Interactively from Human Teachers (ALIHT 2011), Barcelona (Spain), 6 pages, 2011. BibTex
B. CHEVAILLIER, J.L. COLLETTE, D. MANDRY, M. CLAUDON, O. PIETQUIN, "Segmentation fonctionnelle de squences d'IRM rnales rehaussement de contraste par quantification vectorielle". In Colloque Recherche en Imagerie et Technologies pour la Sant (RITS 2011), Rennes (France), 3 pages, 2011. BibTex
S. CHAGUE, J. D'HOSE, J.F. GOUDOU, B. DORIZZI, L. GIULIERI, Q.C. PHAM, F. SDES, M. BRUT, D. NICHOLSON, O. PIETQUIN, "METHODEO : Mthodologie dvaluation des algorithmes dexploitation des enregistrements de la vidoprotection". In Workshop Interdisciplinaire sur la Scurit Globale (WISG 2011), Troyes (France), 6 pages, 2011. BibTex

- 2010 -

Regular Papers :

J. FIX, N. ROUGIER, F. ALEXANDRE, "A Dynamic Neural Field Approach to the Covert and Overt Deployment of Spatial Attention". In Cognitive Computation, 2010. BibTex
M. GEIST, O. PIETQUIN, "Kalman Temporal Differences". In Journal of Artificial Intelligence Research (JAIR), 39:483-532, 2010. BibTex
B. FERNANDEZ, J. OSTER, M. LOHEZIC, D. MANDRY, O. PIETQUIN, P.A. VUISSOZ, J. FELBLINGER, "Adaptive Black Blood Fast Spin Echo for End-Systolic Rest Cardiac Imaging". In Magnetic Resonance in Medicine, 64(6):1760-1771, 2010. BibTex
J. OSTER, O. PIETQUIN, M. KRAEMER, J. FELBLINGER, "Nonlinear Bayesian Filtering for Denoising of Electrocardiograms acquired in a Magnetic Resonance Environment". In IEEE Transactions on Biomedical Engineering, ISBN: 0018-9294, 57(7):1628 - 1638, 2010. BibTex
F. PENNERATH, G. NIEL, P. VISMARA, P. JAUFFRET, C. LAURENO, A. NAPOLI, "A graph-mining algorithm for the evaluation of bond formability". In Journal of Chemical Information and Modeling, 50(2):221-239, 2010. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Diffrences temporelles de Kalman : cas dterministe". In Revue d'Intelligence Artificielle, 24(4):423-442, 2010. BibTex

Conference Proceedings :

J. FIX, H. SCHROLL, K. ANTON-ERXLEBEN, T. WOMELSDORF, S. TREUE, F. HAMKER, "Influence of Spatial Attention on the Receptive Field Shape of Neurons in Monkey Area MT". In Proceedings of the 5th french conference on computational neuroscience Neurocomp 10 . In Proceedings of the 5th french conference on computational neuroscience Neurocomp 10 :147--152, 2010. BibTex
M. GEIST, O. PIETQUIN, "Eligibility Traces through Colored Noises". In Proceedings of the IEEE International Conference on Ultra Modern Control systems (ICUMT 2010), ISBN: 978-1-4244-7285-7:458 - 465, Moscow (Russia), (best paper award), 2010. BibTex
M. GEIST, O. PIETQUIN, "Statistically Linearized Least-Squares Temporal Differences". In Proceedings of the IEEE International Conference on Ultra Modern Control systems (ICUMT 2010), ISBN: 978-1-4244-7285-7, IEEE:450 - 457, Moscow (Russia), 2010. BibTex
M. GEIST, O. PIETQUIN, "Revisiting natural actor-critics with value function approximation". In Proceedings of the 22nd Benelux Conference on Artificial Intelligence (BNAIC 2010), Luxembourg (Luxembourg), 1-page abstract, 2010. BibTex
F. PENNERATH, "Fast Extraction of Locally Optimal Patterns based on Consistent Pattern Function Variations". In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2010, Jos L. Balcazar and Francesco Bonchi and Aristides Gionis and Michle Sebag, ISBN: 978-3-642-15938-1, Springer, Lecture Notes in Computer Science, 6323:34-49, Barcelona (Spain), 2010. BibTex
S. ROSSIGNOL, O. PIETQUIN, "Single-speaker/multi-speaker co-channel speech classification". In Proceedings of the International Conference on Speech Communication and Technologies (Interspeech 2010), ISCA:2322-2325, Makuhari (Japan), 2010. BibTex
S. CHANDRAMOHAN, M. GEIST, O. PIETQUIN, "Optimizing Spoken Dialogue Management with Fitted Value Iteration". In Proceedings of the International Conference on Speech Communication and Technologies (Interspeech 2010), ISCA:86-89, Makuhari (Japan), 2010. BibTex
S. CHANDRAMOHAN, M. GEIST, O. PIETQUIN, "Sparse Approximate Dynamic Programming for Dialog Management". In Proceedings of the 11th SIGDial Conference on Discourse and Dialogue, ACL:107-115, Tokyo (Japan), 2010. BibTex
M. GEIST, O. PIETQUIN, "Statistically Linearized Recursive Least Squares". In Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2010), ISBN: 978-1-4244-7875-0:272 - 276, Kittil (Finland), 2010. BibTex
B. CHEVAILLIER, J.L. COLLETTE, D. MANDRY, M. CLAUDON, O. PIETQUIN, "Objective assessment of renal DCE-MRI image segmentation". In Proceedings of the European Signal Processing Conference (EUSIPCO 2010), ISBN: 2076-1465, Eurasip, Aalborg (Denmark), 1214-1218, 2010. BibTex
J. GUSTEDT, S. VIALLE, H. FREZZA-BUET, D. BOUMBA SITOU, N. FRESSENGEAS, "InterCell: a Software Suite for Rapid Prototyping and Parallel Execution of Fine Grained Applications". In PARA 2010 conference: State of the Art in Scientific and Parallel Computing, Reykjavick, Iceland, 2010. BibTex
S. ROSSIGNOL, O. PIETQUIN, M. IANOTTO, "Simulation du processus de croyance mutuelle de la comprhension dans le dialogue (grounding process) l'aide des rseaux baysiens". In Actes des Journes d'Etude de la Parole (JEP 2010), Mons (Belgium), 5 pages, 2010. BibTex
M. GEIST, O. PIETQUIN, "Gestion de l'incertitude dans le cadre de l'approximation de la fonction de valeur pour l'apprentissage par renforcement". In actes de la confrence francophone sur l'apprentissage automatique (CAP 2010), PUG:101-112, Clermont-Ferrand (France), 2010. BibTex
B. FERNANDEZ, J. OSTER, M. LOHEZIC, D. MANDRY, O. PIETQUIN, P.A. VUISSOZ, J. FELBLINGER, "Beat to Beat Management of Heart Cycle Changes for Black Blood Imaging in End-Systolic Rest". In Proceedings of the ISMRM workshop on Current Concepts of Motion Correction for MRI and MRS, Kitzbuhel (Austria), 2010. BibTex
J.L. GUTZWILLER, H. FREZZA-BUET, O. PIETQUIN, "Online Speaker Diarization with a Size-Monitored Growing Neural Gas Algorithm". In Proceedings of the 18 th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Michel Verleysen:505-510, Bruges (Belgium), 2010. BibTex
J. OSTER, O. PIETQUIN, M. KRAEMER, J. FELBLINGER, "Bayesian Framework for Artifact Reduction on ECG in MRI". In Proceedings of the 35th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2010):489-492, Dallas (TX, USA), 2010. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Astuce du Noyau & Quantification Vectorielle". In Actes du 17me colloque sur la Reconnaissance des Formes et l'Intelligence Artificielle (RFIA'10), Caen (France), 8 pages, 2010. BibTex
M. SAIDI, O. PIETQUIN, R. ANDRÉ-OBRECHT, "Application of the EMD decomposition to discriminate nasalized vs. vowels phones in French". In Proceedings of the International Conference on Signal Processing, Pattern Recognition and Applications (SPPRA 2010), ACTA Press:128-132, Innsbruck (Austria), 2010. BibTex

Book Chapters :

S. CHANDRAMOHAN, O. PIETQUIN, "User and Noise Adaptive Dialogue Management Using Hybrid System Actions". In Spoken Dialogue Systems for Ambient Environments, Gary Geunbae Lee and Joseph Mariani and Wolfgang Minker and Satoshi Nakamura, ISBN: 978-3-642-16201-5, Springer Verlag, Heidelberg - Berlin, Lecture Notes in Artificial Intelligence (LNAI), 6392:13-24, Gotemba, Shizuoka (Japan), Proceedings of the International Workshop on Spoken Dialogue Systems (IWSDS 2010), 2010. BibTex
S. ROSSIGNOL, O. PIETQUIN, M. IANOTTO, "Grounding Simulation in Spoken Dialog Systems with Bayesian Networks". In Spoken Dialogue Systems for Ambient Environments, Gary Geunbae Lee and Joseph Mariani and Wolfgang Minker and Satoshi Nakamura, ISBN: 978-3-642-16201-5, Springer-Verlag, Heidelberg-Berlin, Lecture Notes in Artificial Intelligence (LNAI), 6392:110-121, Gotemba, Shizuoka (Japan), Proceedings of the 2nd International Workshop on Spoken Dialogue Systems (IWSDS 2010), 2010. BibTex
M. GEIST, O. PIETQUIN, "Revisiting natural actor-critics with value function approximation". In Modeling Decisions for Artificial Intelligence, V. Torra and Y. Narukawa and M. Daumas, Springer Verlag - Heidelberg Berlin, Lecture Notes in Artificial Intelligence (LNAI), 6408:207-218, Perpinya (France), Proceedings of 7th International Conference MDAI 2010, 2010. BibTex
O. PIETQUIN, "Natural Language and Dialogue Processing". In Multi-modal signal processing: methods and techniques to build multimodal interactive systems, Jean-Philippe Thiran, Herv Bourlard, Ferran Marqus, ISBN: 0123748259, Elsevier Science & Technology Books, 4:61-90, 2010. BibTex

Thesis :

B. CHEVAILLIER, "Analyse de donnes dIRM fonctionnelle rnale par quantification vectorielle", Thse en Mathmatiques, PhD Thesis, Universit Paul Verlaine de Metz, 2010. BibTex

Technical Reports :

S. KEIZER, O. PIETQUIN, S. ROSSIGNOL, S. YOUNG, "Agenda-based user simulations and EM training tools for Appointment Scheduling and TownInfo domains" (3.4), CLASSiC Project Deliverable, 2010. BibTex
M. GEIST, O. PIETQUIN, "A Brief Survey of Parametric Value Function Approximation", Suplec, 2010. BibTex
O. PIETQUIN, H. HASTIE, "Metrics for the evaluation of user simulation" (3.5), CLASSiC Project Deliverable, 2010. BibTex

Patents :

J.P. MORARD, O. PIETQUIN, S. VIALLE, "Procd d'encodage par segmentation d'une image ", Patent n FR 2940577, 2010. BibTex
J.P. MORARD, O. PIETQUIN, S. VIALLE, "METHOD FOR THE SEGMENTATION ENCODING OF AN IMAGE", Patent n WO/2010/072983, 2010. BibTex

Workshops :

M. GEIST, "Statistical Linearization for Value Function Approximation in Reinforcement Learning". In NIPS Workshop Optimization for Machine Learning (OPT 2010), Vancouver (Canada), 6 pages, 2010. BibTex
R. ARAS, O. PIETQUIN, "Optimal Average Reward Controllers For POMDPs". In Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2010), Besanon (France), 6 pages, 2010. BibTex
M. GEIST, O. PIETQUIN, "Statistically Linearized Least-Squares Temporal Differences". In Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2010), Besanon (France), 8 pages, 2010. BibTex
M. GEIST, O. PIETQUIN, "Revisiting natural actor-critics with value function approximation". In Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2010), Besanon (France), 6 pages, 2010. BibTex
M. GEIST, O. PIETQUIN, "Managing Uncertainty within Value Function Approximation in Reinforcement Learning". In Active Learning and Experimental Design workshop (collocated with AISTATS 2010), Sardinia, Italy, 8 pages, oral presentation, 2010. BibTex

- 2009 -

Regular Papers :

J. VITAY, J. FIX, F. HAMKER, H. SCHROLL, F. BEUTH, "Biological Models of Reinforcement Learning". In Knstliche Intelligenz, 3-09:12--18, 2009. BibTex
J. OSTER, O. PIETQUIN, R. ABCHERLI, M. KRAEMER, J. FELBLINGER, "Independent component analysis based artefact reduction: application to electrocardiogram for improved magnetic resonance imaging triggering ". In Physiological Measurement, 30:1381-1397, 2009. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "From Supervised to Reinforcement Learning: a Kernel-based Bayesian Filtering Framework". In International Journal On Advances in Software, ISBN: 1942-2628, 2(1):101-116, 2009. BibTex

Conference Proceedings :

O. PIETQUIN, S. ROSSIGNOL, M. IANOTTO, "Training Bayesian networks for realistic man-machine spoken dialogue simulation". In Proceedings of the 1rst International Workshop on Spoken Dialogue Systems Technology (IWSDS 2009), Irsee (Germany), 4 pages, 2009. BibTex
L. ALECU, H. FREZZA-BUET, "Application-driven parameter tuning methodology for dynamic neural field equations". In Neural Information Processing, ICONIP'09 Proceedings, Part I, ISBN: 978-3-642-10676-7, Springer Berlin / Heidelberg, Lecture Notes in Computer Science, 5863/2009:135-142, Bangkok (Thailand), 2009. BibTex
F. PENNERATH, A. NAPOLI, "The Model of Most Informative Patterns and its Application to Knowledge Extraction from Graph Databases". In Machine Learning and Knowledge Discovery in Databases, European Conference (ECML PKDD 2009), Proceedings, Part II, Wray L. Buntine and Marko Grobelnik and Dunja Mladenic and John Shawe-Taylor, ISBN: 978-3-642-04173-0, Springer, Lecture Notes in Computer Science, 5782:205-220, Bled (Slovenia), 2009. BibTex
L. ALECU, H. FREZZA-BUET, "A dynamic neural field mechanism for self-organization". In Supplement of the online journal BMC Neuroscience, The nineteenth Annual Computational Neuroscience Meeting, 10(Suppl 1):P273, Berlin (Germany), 2009. BibTex
M. SAIDI, O. PIETQUIN, R. ANDRÉ-OBRECHT, "EMD decomposition to discriminate nasal vs. oral vowels in French ". In Proceedings of the 13th International conference on Speech and Computer (SPECOM 2009), St Petersburg (Russia), 5 pages, 2009. BibTex
B. FERNANDEZ, J. OSTER, M. LOHEZIC, D. MANDRY, O. PIETQUIN, P.A. VUISSOZ, J. FELBLINGER, "Synchronisation Adaptative Utilisant un Modle Prdictif : Applications lImagerie Cardiaque par Rsonance Magntique en Sang Noir et en Systole". In Actes des Journes de Recherche en Imagerie et Technologies de la Sant (RITS 2009), Lille (France), 2009. BibTex
M. LOHEZIC, B. FERNANDEZ, J. OSTER, D. MANDRY, O. PIETQUIN, P.A. VUISSOZ, J. FELBLINGER, "Free breathing black-blood systolic imaging using heart rate prediction and motion compensated reconstruction". In Proceedings of the 17th meeting of the International Society for Magnetic Resonance Medicine (ISMRM 2009):4629, Honolulu (Hawaii, USA), 2009. BibTex
B. FERNANDEZ, J. OSTER, M. LOHEZIC, D. MANDRY, O. PIETQUIN, P.A. VUISSOZ, J. FELBLINGER, "Adaptive Trigger Delay Using a Predictive Model Applied to Black Blood Fast Spin Echo Cardiac Imaging in Systole". In Proceedings of the 17th meeting of the International Society for Magnetic Resonance Medicine (ISMRM 2009):4719, Honolulu (Hawaii, USA), 2009. BibTex
J. OSTER, B. FERNANDEZ, M. LOHEZIC, D. MANDRY, P.A. VUISSOZ, O. PIETQUIN, J. FELBLINGER, "Adaptive Heart Rate Prediction for Black-Blood Systolic Iimaging". In Proceedings of the 17th meeting of the International Society for Magnetic Resonance Medicine (ISMRM 2009):3936, Honolulu (Hawaii, USA), 2009. BibTex
J. OSTER, J. PASCAL, O. PIETQUIN, M. KRAEMER, J.P. BLOND, J. FELBLINGER, "Real-Time Adaptive suppression of MR gradient Artifacts on Electorcardiograms using a new 3D Hall Probe". In Proceedings of the 17th meeting of the International Society for Magnetic Resonance Medicine (ISMRM 2009):751, Honolulu (Hawaii, USA), 2009. BibTex
L. ALECU, H. FREZZA-BUET, "Reconciling neural fields to self-organization". In European Symposium on Artificial Neural Networks - Advances in Computational Intelligence and Learning (ESANN), Bruges, Belgium, Michel Verleysen, ISBN: 2-930307-09-9:571-576, 2009. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Kernelizing Vector Quantization Algorithms". In Proceedings of the 17th European Symposium on Artificial Neural Networks (ESANN 09), Michel Verleysen:541-546, Bruges (Belgium), 2009. BibTex
J. OSTER, O. PIETQUIN, R. ABCHERLI, M. KRAEMER, J. FELBLINGER, "A Specific QRS Detector for Electrocardiography during MRI: Using Waveltets and Local Regularity Characterization". In Proceedings of the 34th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2009):341-344, Taipei (Taiwan), 2009. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Kalman Temporal Differences: the deterministic case ". In IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2009):185-192, Nashville (TN, USA), 2009. BibTex

Book Chapters :

B. CHEVAILLIER, D. MANDRY, J.L. COLLETTE, M. CLAUDON, O. PIETQUIN, "Functional semi-automated segmentation of renal DCE-MRI sequences using a Growing Neural Gas algorithm". In Recent Advances in Signal Processing, Ashraf A. Zaher, ISBN: 978-953-307-002-5, 5:69-80, 2009. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Tracking in Reinforcement Learning". In Proceedings of the 16th International Conference on Neural Information Processing (ICONIP 2009), Springer LNCS, 5863, Part I:502-511, Bangkok (Thailand), ENNS best student paper award, 2009. BibTex
O. PIETQUIN, "Machine Learning Methods for Spoken Dialogue Simulation and Optimization". In Machine Learning, Abdelhamid Mellouk and Abdennacer Chebira, ISBN: 978-953-7619-56-1, IN-TECH:167-184, 2009. BibTex

Proceedings :

O. LEMON, O. PIETQUIN, "Machine learning for adaptivity in spoken dialogue systems, Special Session at Interspeech 2009", Brighton (UK), 2009. BibTex

Thesis :

M. GEIST, "Optimisation des chanes de production dans l'industrie sidrurgique : une approche statistique de l'apprentissage par renforcement", PhD thesis in Mathematics, PhD Thesis, Universit Paul Verlaine de Metz (en collaboration avec Suplec, ArcelorMittal et l'INRIA), 2009. BibTex
F. PENNERATH, "Mthodes d'extraction de connaissances partir de donnes modlisables par des graphes. Application des problmes de synthse organique.", PhD Thesis, Nancy-Universit, 2009. BibTex

Technical Reports :

F. ALEXANDRE, J. FIX, N. ROUGIER, T. VIEVILLE, "Algorithmic adjustment of neural field parameters", 2009. BibTex
O. PIETQUIN, S. ROSSIGNOL, M. IANOTTO, P. CROOK, "Probabilistic user simulations for training in the (PO)MDP framework including the simulation of grounding in TownInfo dialogues" (3.2), CLASSiC Project Deliverable, 2009. BibTex
O. LEMON, O. PIETQUIN, H. FREZZA-BUET, V. RIESER, X. LIU, P. BRETIER, S. YOUNG, J. HENDERSON, "Shared Context Model (XML Schema)" (3.1), CLASSiC Project Deliverable, 2009. BibTex
O. PIETQUIN, H. FREZZA-BUET, P. CROOK, "New frameworks for generalization, with implementation in DIPPER ISU DM system" (1.2), CLASSiC Project Deliverable, 2009. BibTex

Patents :

J.P. MORARD, S. VIALLE, O. PIETQUIN, V. GALTIER, "PROCEDE DE DIFFUSION DE SEQUENCES DE DONNEES VIDEO PAR UN SERVEUR VERS UN TERMINAL CLIENT", Brevet n FR2920933 (A1), 2009. BibTex
J.P. MORARD, S. VIALLE, O. PIETQUIN, V. GALTIER, "METHOD FOR BROADCASTING VIDEO DATA SEQUENCES BY A SERVER TO A CLIENT TERMINAL", Patent n WO/2009/034275, 2009. BibTex

Workshops :

D. BOUMBA SITOU, S. OULD SAAD HAMADY, N. FRESSENGEAS, H. FREZZA-BUET, S. VIALLE, J. GUSTEDT, "Cellular based simulation of semiconductors thin films". In Innovations in Thin Film Processing and Characterization (ITFPC 09), Nancy (France), 2009. BibTex
B. FERNANDEZ, J. OSTER, M. LOHEZIC, D. MANDRY, O. PIETQUIN, P.A. VUISSOZ, J. FELBLINGER, "Amlioration de limagerie du ventricule droit en IRM cardiaque en sang noir par une mthode adaptative". In Journe Claude Huriet, Nancy (France), 2009. BibTex
J.L. COLLETTE, O. PIETQUIN, "Localisation de Source Sonore par Goniometrie Acoustique pour la Dtection de Chute". In 2me colloque PARAChute, Troyes (France), 2009. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Diffrences Temporelles de Kalman : le cas stochastique". In Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2009), Paris (France), 13 pages, 2009. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Diffrences Temporelles de Kalman". In Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2009), Paris (France), 20 pages, 2009. BibTex

- 2008 -

Regular Papers :

D. MANDRY, B. CHEVAILLIER, Y. PONVIANNE, J.L. COLLETTE, M.A. GALLOY, O. PIETQUIN, M. CLAUDON, "Segmentation fonctionnelle rnale semi-automatique par quantification vectorielle de sries dynamiques en IRM". In Journal de Radiologie, 2008. BibTex
F. PENNERATH, A. NAPOLI, "La famille des motifs les plus informatifs. Application l'extraction de graphes en chimie organique.". In Information - Interaction - Intelligence Journal (I3), 8(2):153-179, (Version tendue d'articles slectionns dans les actes de RFIA 2008), 2008. BibTex
A. RABAOUI, M. DAVY, S. ROSSIGNOL, N. ELLOUZE, "One-Class SVMs and Wavelets for Audio Surveillance". In IEEE Transactions on Information Forensics & Security, 2008. BibTex
H. FREZZA-BUET, "Following non-stationary distributions by controlling the vector quantization accuracy of a growing neural gas network". In Neurocomputing, 71(7-9):1191-1202, 2008. BibTex

Conference Proceedings :

F. ALEXANDRE, J. FIX, A. HUTT, N. ROUGIER, T. VIEVILLE, "On practical neural field parameters adjustment". In Deuxime confrence franaise de Neurosciences Computationnelles, "Neurocomp08", 2008. BibTex
J. FIX, N. ROUGIER, F. ALEXANDRE, "A computational approach to the covert and overt deployment of spatial visual attention". In Deuxime confrence franaise de Neurosciences Computationnelles, "Neurocomp08", 2008. BibTex
S. ROSSIGNOL, J.L. COLLETTE, "A method for simultaneously extract the fundamental frequency of a speech signal and segment it". In IEEE Symposium on Signal Processing and Information Technology (ISSPIT 2008):213-218, Sarajevo (Bosnia & Herzegovina), 2008. BibTex
S. ROSSIGNOL, O. PIETQUIN, "Precise Voicing Information Extraction in Speech Signals Using the Analytic Signal". In Proceedings of the 8th IEEE Symposium on Signal Processing and Information Technology (ISSPIT 2008):207-212, Sarajevo (Bosnia & Herzegovina), 2008. BibTex
L. ALECU, H. FREZZA-BUET, "An Empirical Evaluation Framework for Qualifying Dynamic Neural Fields". In Proceedings of the second french conference on Computational Neuroscience, Neurocomp, Marseille, Laurent E. Perrinet and Emmanuel Dauc, ISBN: 978-2-9532965-0-1:(4 pages), 2008. BibTex
L. ALECU, H. FREZZA-BUET, "Are Neural Fields Suitable for Vector Quantization?". In Proceedings of The Seventh International Conference on Machine Learning and Applications (ICMLA'08), IEEE:239-244, San Diego (CA, USA), 2008. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Online Bayesian Kernel Regression from Nonlinear Mapping of Observations". In Proceedings of the 18th IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2008) (a53):309-314, Cancun (Mexico), 2008. BibTex
M. CLAUDON, D. MANDRY, C. PASQUIER, B. CHEVAILLIER, J.L. COLLETTE, O. PIETQUIN, "Functional semi-automated segmentation of renal DCE-MRI sequences: preliminary results". In Proceedings of the 15th Symposium of the European Society of Urogenital Radiology (ESUR 2008), Munich (Germany), 2008. BibTex
J. OSTER, O. PIETQUIN, M. KRAEMER, J. FELBLINGER, "Independent Component Analysis based Artifact Reduction Method for ECG in MR". In Proceedings of the European Society for Magnetic Resonance in Medicine and Biology congress (ESMRMB 08), Valencia (Spain), 2008. BibTex
F. PENNERATH, G. POLAILLON, A. NAPOLI, "Mining Intervals of Graphs to Extract Characteristic Reaction Patterns". In Discovery Science, 11th International Conference, DS 2008 Proceedings., Boulicaut J.-F. and Berthold M.R. and Horvrth T., Springer-Verlag, Lecture Notes in Artificial Intelligence, 5255:210-221, Budapest (Hungary), 2008. BibTex
D. MANDRY, B. CHEVAILLIER, J.L. COLLETTE, M.A. GALLOY, Y. PONVIANNE, J. FELBLINGER, O. PIETQUIN, M. CLAUDON, "Functional semi-automated segmentation of renal DCE-MRI sequences using vector quantization". In Proceedings of the European Society for Magnetic Resonance in Medicine and Biology congress (ESMRMB 08), Valencia (Spain), 2008. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "A Sparse Nonlinear Bayesian Online Kernel Regression". In Proceedings of the 2nd IEEE International Conference on Advanced Engineering Computing and Applications in Sciences (AdvComp 2008), I:199-204, Valencia (Spain), (best paper award), 2008. BibTex
D. MANDRY, B. CHEVAILLIER, Y. PONVIANNE, J.L. COLLETTE, M.A. GALLOY, O. PIETQUIN, M. CLAUDON, "Segmentation fonctionnelle rnale semi-automatique par quantification vectorielle de sries dynamiques en IRM". In Journes Franaises de Radiologie (JFR 2008), Paris (France), 2008. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Filtrage baysien de la rcompense". In actes des Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2008):113-122, Metz (France), 2008. BibTex
F. PENNERATH, G. POLAILLON, A. NAPOLI, "A Method for Classifying Vertices of Labeled Graphs Applied to Knowledge Discovery from Molecules". In Proceedings of the 18th European Conference on Artificial Intelligence (ECAI'2008), Malik Ghallab and Constantine D. Spyropoulos and Nikos Fakotakis and Nikos Avouris, ISBN: 978-1-58603-891-5, IOS Press, 178:147-151, Patras, Greece, 2008. BibTex
B. CHEVAILLIER, D. MANDRY, Y. PONVIANNE, J.L. COLLETTE, M. CLAUDON, O. PIETQUIN, "Functional semi-automated segmentation of renal DCE-MRI sequences using a Growing Neural Gas algorithm". In Proceedings of the 16th European Signal Processing Conference (EUSIPCO'08):5 pages (Proceedings on CDROM), Lausanne (Switzerland), 2008. BibTex
J. OSTER, O. PIETQUIN, M. KRAEMER, J. FELBLINGER, "Mthode de rduction des artfacts prsents sur lECG base sur lanalyse en composantes indpendantes". In Actes du 12me congrs du Groupe de Recherche sur les Applications du Magntisme en Mdecine (GRAMM'08), Lyon (France), 2008. BibTex
F. PENNERATH, G. POLAILLON, A. NAPOLI, "Prtraitement des bases de donnes de ractions chimiques pour la fouille de schmas de ractions". In Actes des 8mes journes Extraction et Gestion des Connaissances, Sophia-Antipolis, France, 29 janvier au 1er fvrier, 2 Volumes, Fabrice Guillet and Brigitte Trousse, Cpadus-Editions, Revue des Nouvelles Technologies de l'Information, 2(RNTI-E-11):547-558, 2008. BibTex
F. PENNERATH, A. NAPOLI, "Le problme de l'extraction des graphes informatifs. Application l'extraction de connaissance partir de bases de ractions chimiques". In 16e congrs francophone AFRIF-AFIA. Reconnaissance des Formes et Intelligence Artificielle (RFIA):133-142, Amiens (France), 2008. BibTex
B. CHEVAILLIER, Y. PONVIANNE, J.L. COLLETTE, D. MANDRY, M. CLAUDON, O. PIETQUIN, "Functional Semi-Automated Segmentation of Renal DCE-MRI Sequences". In Proceedings of the 33rd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2008):525-528, Las Vegas (NV, USA), 2008. BibTex
J. OSTER, O. PIETQUIN, G. BOSSER, J. FELBLINGER, "Adaptive RR Prediction for Cardiac MRI". In Proceedings of the 33rd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2008):513-516, Las Vegas (NV, USA), 2008. BibTex

Book Chapters :

M. GEIST, O. PIETQUIN, G. FRICOUT, "Bayesian Reward Filtering". In Recent Advances in Reinforcement Learning, S. Girgin et al., Springer Verlag, Lecture Notes in Computer Science (LNCS), 5323:96-109, Revised and selected papers of EWRL 2008, 2008. BibTex
O. PIETQUIN, "Optimising Spoken Dialogue Strategies within the Reinforcement Learning Paradigm ". In Reinforcement Learning, Theory and Applications, Cornelius Weber, Mark Elshaw and Norbert Michael Mayer, ISBN: 978-3-902613-14-1, I-Tech Education and Publishing, Vienna, Austria:239-256, 2008. BibTex

Proceedings :

O. PIETQUIN, H. FREZZA-BUET, "Actes des Journes Francophones de Planification, Dcision et Apprentissage pour la conduite de systmes (JFPDA 2008)", 2008. BibTex

Thesis :

J. FIX, "Mcanisme numriques et distribus de lanticipation motrice", PhD Thesis, Univerist Henri Poincar Nancy-I, 2008. BibTex

Technical Reports :

S. LABORIE, F. SDES, J.F. SULZER, O. PIETQUIN, N. ALLEZARD, R. PINCHUK, J.P. GUIGNARD, P. MOREIRA, C. FERNANDEZ, S. MOENS, J.F. SEIGNOLE, D. MILAN, "Proposed Content Indexation Agent Software" (D3.1), LINDO Deliverable, 2008. BibTex
J.F. SULZER, J.P. GUIGNARD, J.F. SEIGNOLE, F. SDES, O. PIETQUIN, R. PINCHUK, S. MOENS, D. MILAN, N. ALLEZARD, P. MOREIRA, C. FERNANDEZ, A.M. MANZAT, "Prleiminary Requirement Specification (generic and applicative)" (D2.1), LINDO deliverable, 2008. BibTex

Patents :

O. PIETQUIN, V. PHILOMIN, "Method of Determining Motion-Related Features and Method of Performing Motion Classification", Patent n WO2008139399, 2008. BibTex
O. PIETQUIN, "A METHOD OF RECOGNIZING A MOTION PATTERN OF AN OBJECT", Patent n EP1904951, 2008. BibTex

Workshops :

M. GEIST, O. PIETQUIN, G. FRICOUT, "Bayesian Reward Filtering". In 8th European Workshop on Reinforcement Learning (EWRL 2008), Lille (France), 14 pages, 2008. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Filtrage Baysien de la Rcompense". In Journe NeuroInfo - Loria, Nancy (France), 2008. BibTex
B. FERNANDEZ, J. OSTER, M. LOHEZIC, D. MANDRY, O. PIETQUIN, P.A. VUISSOZ, J. FELBLINGER, "Synchronisation Adaptative Utilisant un Modle Prdictif : Applications lImagerie Cardiaque par Rsonance Magntique en Sang Noir et en Systole", Journe Claude Huriet, Nancy (France), 2008. BibTex
M. GEIST, "Kalman Temporal Differences". In Cross-border workshop of PhD students in fundamental and applied mathematics (LMAM - UPVM), Metz (France), Invited Speaker, 2008. BibTex
M. GEIST, O. PIETQUIN, G. FRICOUT, "Kalman Temporal Differences: Uncertainty and Value Function Approximation". In NIPS Workshop on Model Uncertainty and Risk in Reinforcement Learning, Vancouver (Canada), 2008. BibTex
F. GASPARD, O. PIETQUIN, F. SDES, J.F. SEIGNOLE, J.F. SULZER, "Architecture Gnrique de Stockage Multimedia Rparti avec Recherche et Indexation distribues (Projet ITEA2 LINDO)". In Journe d'tude sur l'Analyse Vido pour le Renseignement et la Scurit (AViRS 2008), SEE, Paris (France), 2008. BibTex