SUMMARY OF JUERGEN SCHMIDHUBER'S PROFESSIONAL ACTIVITIES IN 2009 PUBLICATIONS OF 2009 For pre-2009 articles, PDFs / HTMLs / overviews see http://www.idsia.ch/~juergen/onlinepub.html BOOKS 2009 J. Schmidhuber, F. Gomez, A. Graves, S. Hochreiter. Sequence Learning with Artificial Recurrent Neural Networks. Invited by Cambridge University Press, in preparation. (Aiming to become THE textbook on RNN). JOURNALS 2009 6. J. Schmidhuber. Ultimate Cognition ā la Gödel. Cognitive Computation 1(2):177-193, 2009. 5. J. Schmidhuber. Simple Algorithmic Theory of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes. Journal of SICE, 48(1):21-32, 2009. 4. D. Ryabko and J. Schmidhuber. Using Data Compressors to Construct Order Tests for Homogeneity and Component Independence. Applied Mathematics Letters, 2009. 3. A. Graves, M. Liwicki, S. Fernandez, R. Bertolami, H. Bunke, J. Schmidhuber. A Novel Connectionist System for Improved Unconstrained Handwriting Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 5, 2009. 2. D. Wierstra, A. Foerster, J. Peters, J. Schmidhuber. Recurrent Policy Gradients. Journal of Algorithms, 2009. 1. J. Togelius, T. Schaul, D. Wierstra, C. Igel, F. Gomez, J. Schmidhuber. Ontogenetic and Phylogenetic Reinforcement Learning. Kuenstliche Intelligenz, 2009. INVITED BOOK CHAPTERS 2009 2. J. Schmidhuber. Art & science as by-products of the search for novel patterns, or data compressible in unknown yet learnable ways. In M. Botta (ed.), Multiple ways to design research. Research cases that reshape the design discipline, Milano-Lugano, Swiss Design Network - Et al. Edizioni, 2009, pp. 98-112. (Based on Keynote talk.) 1. J. Schmidhuber. Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes. In G. Pezzulo, M. V. Butz, O. Sigaud, G. Baldassarre, eds.: Anticipatory Behavior in Adaptive Learning Systems, from Sensorimotor to Higher-level Cognitive Capabilities, Springer, LNAI, 2009. (Based on keynote talk for KES 2008 and joint invited lecture for ALT 2007 / DS 2007.) CONFERENCES 2009 10.S. Yi, D. Wierstra, T. Schaul, J. Schmidhuber. Efficient Natural Evolution Strategies. Genetic and Evolutionary Computation Conference (GECCO-09), Montreal, 2009. Best paper award. 9. S. Yi, D. Wierstra, T. Schaul, J. Schmidhuber. Stochastic Search using the Natural Gradient. Proceedings of the 26th International Conference on Machine Learning (ICML-09), Montreal, 2009. 8. A. Graves, J. Schmidhuber. Offline Handwriting Recognition with Multidimensional Recurrent Neural Networks. Advances in Neural Information Processing Systems 22, NIPS'22, p 545-552, Vancouver, MIT Press, 2009. 7. J. Bayer, D. Wierstra, J. Togelius, J. Schmidhuber. Evolving memory cell structures for sequence learning. Proceedings of the 19th International Conference on Artificial Neural Networks (ICANN-09), Cyprus, 2009. 6. J. Unkelbach, S. Yi, J. Schmidhuber. An EM based training algorithm for recurrent neural networks. Proceedings of the 19th International Conference on Artificial Neural Networks (ICANN-09), Cyprus, 2009. 5. T. Schaul and J. Schmidhuber. A Scalable Neural Network Architecture for Board Games. Proceedings of the 19th International Conference on Artificial Neural Networks (ICANN-09), Cyprus, 2009. 4. F. J. Gomez, J. Togelius, J. Schmidhuber. Measuring and Optimizing Behavioral Complexity for Evolutionary Reinforcement Learning . Proceedings of the 19th International Conference on Artificial Neural Networks (ICANN-09), Cyprus, 2009. 3. J. Togelius, S. Karakovskiy, J. Koutnik, and J. Schmidhuber. Super Mario Evolution. Proceedings of the 2009 IEEE Symposium on Computational Intelligence in Games CIG-2009, p. 156-161, Milano, 2009. 2. N. v. Hoorn, J. Togelius, J. Schmidhuber. Hierarchical Controller Learning in a First-Person Shooter. Proceedings of the 2009 IEEE Symposium on Computational Intelligence in Games, CIG-2009, p. 294-301, Milano, 2009. 1. N. v. Hoorn, J. Togelius, D. Wierstra, J. Schmidhuber. Robust player imitation using multiobjective evolution. Proceedings of the Congress on Evolutionary Computation (CEC-09), Trondheim, 2009. TEACHING 2009 WS 2009/2010: Masters Course Intelligent Systems (Machine Learning) SCIENTIFIC SERVICE 2009 JS reviewed scientific grant proposals and papers, and served on the editorial boards of the following journals: 4. IEEE Transactions on Neural Networks 3. Cognitive Computation 2. Paladyn. Journal of Behavioral Robotics 1. Guest editor of special Issue of the journal "Algorithms" on "Algorithmic Complexity in Physics & Embedded Artificial Intelligences" HONORS 2009 3. Best paper award at GECCO 2009 (with Sun Yi, Daan Wierstra, Tom Schaul) 2. ICDAR 2009: Our recurrent neural networks won several handwriting recognition competitions (Schmidhuber's postdoc Alex Graves) 1. Since March 2009 official member of the Academia Scientiarum et Artium Europaea, the European Academy of Sciences and Arts, whose 1317 members include numerous Nobel laureates, renowned architects & artists, and Pope Benedict XVI. Elected in 2008. ALUMNI 2009 (professors only) In 2009, three of Schmidhuber's IDSIA postdocs got professorships abroad: 3. Jan Unkelbach, at Harvard 2. Julian Togelius, at IT Univ. Copenhagen 1. Joerg Conradt, at TU Munich SELECTED INVITED TALKS 2009 Nov 12: Keynote for Multiple Ways to Design 09: Art & Science Oct 10: Keynote for EUCogII, Hamburg Oct 9: Univ. Kiel Oct 8: Univ. Luebeck Oct 3: Singularity Summit, New York City Aug 25: Dirac summer school, Leuven Jun 22: NDES 2009, Switzerland Mar 18: Harvard Mar 17: Boston Univ. Mar 16: MIT Mar 13: UMass Mar 11: NY Univ. Mar 10: Princeton Mar 9: Rutgers Mar 6: Keynote for Artificial General Intelligence AGI-09, Washington DC CONFERENCE ORGANIZATION 2009 Local Conference Chair of the Conference on Artificial General Intelligence AGI-2010, Lugano, Switzerland MISCELLANEOUS 2009 Participation in the Swiss Artist in Lab Program NEW POSITIONS 2009 Full Professor of Artificial Intelligence at Univ. Lugano, Switzerland (JS remains Director of the Swiss AI Lab IDSIA) NEW EXTERNALLY FUNDED PROJECTS STARTING OR ACQUIRED IN 2009 (exchange rates of 2009) Value of Schmidhuber's direct external funding through new grants starting/acquired in 2009: ~US$4.5m (not counting ongoing projects that started earlier). Total value of corresponding new projects: >US$20m 10.EU project NANOBIOTOUCH on artificial fingers (acquired in 2009, starting in 2010)(~US$0.5m; total ~US$5.4m) 9. EU project IM-CLEVER on developmental robotics and intrinsic motivations (~US$1.5m; total ~US$9m) 8. EU project HUMANOBS on learning plausible behavior of virtual avatars (~US$350k; total ~US$3m) 7. EU project STIFF on artificial hands with antagonistic & elastic muscles (~US$580k; total ~US$4.5m) 6. CTI project on handwriting recognition (~US$330k, with Luca Gambardella) 5. SNF project on supervised recurrent networks II (~US$340k) 4. SNF project on theory and practice of general methods for reinforcement learning (~US$425k) 3. Sinergia project on biologically plausible reinforcement learning (~US$280k; total ~US$1.4m) 2. ZSW project on predicting wind energy profitability with RNN (~US$200k). 1. IGSSE project on physical cryptography (~US$200k)