A metal ruler

Sponsored by SIGGEN and in conjunction with INLG 2010.

In order to continue to provide a common forum for the expanding range of shared-task activities involving language generation, we are organising Generation Challenges 2010.

Shared Tasks

The following tasks will run as part of GenChal'10:

  1. The GIVE-2 Challenge (Koller et al.): Generation of natural-language instructions to aid human task-solving in a virtual environment; GIVE-2 will have virtual worlds that permit continuous moves (rather than discrete steps as in GIVE-1). Call for Participation has been posted.
  2. Post-processing referring expressions in extractive summaries (Belz et al.): based on GREC-NEG and DUC data. Call for Participation has been posted.
  3. Question Generation (Rus, Graesser et al.): Call for Participation in preparation.

In addition, several more tasks are in preparation and will be presented for discussion at the GenChal'10 session at INLG'10 (with a view to running them as tasks in 2011):

  1. Working group on shared task in surface realisation using Wall Street Journal corpus (Belz, Hogan, van Genabith, White): see SR Task website for up to date details.
  2. Working group on shared task in referring expression generation in instructional and cooperative dialogues.
  • Helping Our Own Task (Dale and Kilgariff): Text correction, in particular of academic articles written by non-native speakers. See HOO website for up to date details.
  • Dates

    2 August 2009 Submission of task proposals
    23 May 2010 Submission of camera-ready reports
    7-9 July 2010 INLG'10

    Generation Challenges Steering Committee

    • Anja Belz, NLTG, University of Brighton, UK
    • Robert Dale, Macquarie University, Australia
    • Albert Gatt, University of Malta and Unversity of Aberdeen, UK
    • Kevin Knight, Information Sciences Institute, University of Southern California, USA
    • Alexander Koller, Saarland University, Germany
    • Chris Mellish, Aberdeen University, UK
    • Johanna Moore, Edinburgh University, UK
    • Amanda Stent, Stony Brook University, USA
    • Kristina Striegnitz, Union College, USA


    • Anja Belz, NLTG, University of Brighton, UK
    • Albert Gatt, University of Malta and University of Aberdeen, UK
    • Alexander Koller, Computational Linguistics and Phonetics, Saarland University, Germany
    • Eric Kow, NLTG, University of Brighton, UK

    GenChal'10 homepage: http://www.nltg.brighton.ac.uk/research/genchal10
    GenChal'10 email:

    Last modified: 2010-01-14 13:57


    October 2010
    GenChal'11 website available here
    July 2010
    Results reports published in INLG'10 Proceedings
    23 December 2009
    New QG Task added to GenChal'10
    1 December 2009
    EPSRC to fund GenChal'10
    19 October 2009
    GREC'10 Call for Participation
    22 September 2009
    GenChal'10 Call for Papers
    14 August 2009
    2nd Call for Participation for GIVE-2 Task
    07 July 2009
    Announcement and Call for Tasks