Home Research Publications Software Robots Personal Stuff


You can filter the publications by keyword, listed in reverse chronological order (most recent first). Hopefully there will be more of these in the future. :)

  

Note that some papers that have been submitted but not yet accepted, or accepted but not yet revised, are not available online. If you desperately want a copy and can't wait then contact me and I will email one to you.
2009
  1. G.D. Konidaris and A.G. Barto. Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining. To appear, Advances in Neural Information Processing Systems 22, December 2009.

    The code for the Pinball domain is available here. You can also download videos of the solutions shown in the paper.

    An earlier version appeared as: G.D. Konidaris and A.G. Barto. Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining. Technical Report UM-CS-2008-24, Department of Computer Science, University of Massachusetts Amherst, July 2008.

  2. G.D. Konidaris and A.G. Barto. Efficient Skill Learning Using Abstraction Selection. In Proceedings of the Twenty First International Joint Conference on Artificial Intelligence, pages 1107-1112, July 2009.

  3. G.D. Konidaris and A.G. Barto. Towards the Autonomous Acquisition of Robot Skill Hierarchies (poster abstract). In the Robotics: Science and Systems Workshop on Bridging the Gap Between High-Level Discrete Representations and Low-Level Continuous Behaviors, Seattle, June 2009.

  4. G.D. Konidaris and S. Osentoski. Value Function Approximation using the Fourier Basis (extended abstract). In the Multidisciplinary Symposium on Reinforcement Learning, Montreal, Canada, June 2009.

    Source code for the Fourier Basis is available on my software page.

  5. G.D. Konidaris and A.G. Barto. Skill Chaining: Skill Discovery in Continuous Domains (extended abstract). In the Multidisciplinary Symposium on Reinforcement Learning, Montreal, Canada, June 2009.

    The code for the Pinball domain is available here.

2008
  1. G.D. Konidaris and A.G. Barto. Sensorimotor Abstraction Selection for Efficient, Autonomous Robot Skill Acquisition. Proceedings of the 7th IEEE International Conference on Development and Learning, August 2008.

  2. G.D. Konidaris. Autonomous Robot Skill Acquisition (thesis summary). Doctoral Symposium, 23rd National Conference on Artificial Intelligence (AAAI 2008), July 2008.

  3. G.D. Konidaris and S. Osentoski. Value Function Approximation in Reinforcement Learning using the Fourier Basis. Technical Report UM-CS-2008-19, Department of Computer Science, University of Massachusetts Amherst, June 2008.

    Source code for the Fourier Basis is available on my software page.

  4. E.L. Nelson, G.D. Konidaris and N.E. Berthier. Using Real-Time Motion Capture to Measure Handedness in Infants. Poster presentation to be given at the XVIth Biennial International Conference on Infant Studies, Vancouver, Canada, March 2008.

2007
  1. L. Georgopoulos, G.M. Hayes and G.D. Konidaris. A Forward Model of Optic Flow for Detecting External Forces. Proceedings of the IEEE/RSJ 2007 International Conference on Intelligent Robots and Systems, October 2007.

  2. G.D. Konidaris and A.G. Barto. Building Portable Options: Skill Transfer in Reinforcement Learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, pages 895-900, January 2007.

    An earlier version appeared as: G.D. Konidaris and A.G. Barto. Building Portable Options: Skill Transfer in Reinforcement Learning. Technical Report UM-CS-2006-17, Department of Computer Science, University of Massachusetts at Amherst, March 2006.

2006
  1. G.D. Konidaris and A.G. Barto. An Adaptive Robot Motivational System. In From Animals to Animats 9: Proceedings of the 9th International Conference on the Simulation of Adaptive Behavior, pages 346-356, September 2006.

  2. G.D. Konidaris. A Framework for Transfer in Reinforcement Learning. In the ICML-06 Workshop on Structural Knowledge Transfer for Machine Learning, Pittsburgh PA, June 2006.

  3. G.D. Konidaris and A.G. Barto. Autonomous Shaping: Knowledge Transfer in Reinforcement Learning. In Proceedings of the Twenty Third International Conference on Machine Learning (ICML 2006), pages 489-496, June 2006.

    An earlier version appeared as: G.D. Konidaris and A.G. Barto. Autonomous Shaping: Learning to Predict Reward for Novel States. Technical Report UM-CS-2005-58, Department of Computer Science, University of Massachusetts at Amherst, September 2005.

  4. S. Rauchas, B. Rosman, G.D. Konidaris and I.D. Sanders. Language Performance at High School and Success in First Year Computer Science. In Proceedings of the 37th SIGCSE Technical Symposium on Computer Science Education, pages 398-402, March 2006.

2005
  1. F.J. Stewart, T. Taylor and G.D. Konidaris. METAMorph: Experimenting with Genetic Regulatory Networks for Artificial Development. Proceedings of the VIIIth European Conference on Artificial Life (ECAL 2005), September 2005.

  2. A. Stout, G.D Konidaris and A.G. Barto. Intrinsically Motivated Reinforcement Learning: A Promising Framework for Developmental Robot Learning. In The AAAI Spring Symposium on Developmental Robotics, March 2005.

  3. G.D. Konidaris and G.M. Hayes. An Architecture for Behavior-Based Reinforcement Learning (DRAFT). Adaptive Behavior 13(1), pages 5 - 32, March 2005 (submitted December 2003).

2004
  1. G.D. Konidaris and G.M. Hayes. Anticipatory Learning for Focusing Search in Reinforcement Learning Agents, The Second Workshop on Anticipatory Behavior in Adaptive Learning Systems (ABiALS 2004), July 2004.

  2. G.D. Konidaris and G.M. Hayes. Estimating Future Reward in Reinforcement Learning Animats using Associative Learning. In From Animals to Animats 8: Proceedings of the 8th International Conference on the Simulation of Adaptive Behavior, pages 297-304, July 2004.

  3. G.D. Konidaris, T. Taylor and J.C.T Hallam. HydroGen: Automatically Generating Self-Assembly Code for Hydron Units. In Proceedings of The Seventh International Symposium on Distributed Autonomous Robotic Systems, June 2004.

2003
  1. G.D. Konidaris. Behaviour-Based Reinforcement Learning. Master's Thesis, School of Informatics, University of Edinburgh, 2003.

2002
  1. G.D. Konidaris, D.A. Shell and N. Oren. Evolving Neural Networks to Play the Capture Game. Proceedings of the SAICSIT 2002 Postgraduate Symposium, September 2002.

2001
  1. G.D. Konidaris. Axial Line Placement in Deformed Urban Grids. Honours Dissertation, School of Computer Science, University of the Witwatersrand, 2001.

    Also released as: G.D. Konidaris and I.D. Sanders, Axial Line Placement in Deformed Urban Grids. Technical Report TR-Wits-CS-2002-04, School of Computer Science, University of the Witwatersrand, April 2002.

  2. J. Adler, G.D. Christelis, J.A. Deneys, G.D. Konidaris, G. Lewis, A.G. Lipson, R.L. Phillips, D.K. Scott-Dawkins, D.A. Shell, B.V. Strydom, W.M. Trakman and L.D. Van Gool. Finding Adjacencies in Non-Overlapping Polygons. Electronic Paper, Proceedings of the 2001 SAICSIT Conference, September 2001.
gdk at cs dot umass dot edu