Everyone is welcome, including team/collaborative entrants. Newcomers to the field are particularly encouraged. Although contact details will be required for all participants during the submission process, all entries will be presented anonymously to the evaluation panel.
Your challenge is to identify the nature of the phenomenon causing the variability in each lightcurve, whether single or binary microlensing event or variable star. For microlensing events, fit an appropriate model to the data. Analyze as much data as possible before the deadline.
All entries will be evaluated by a panel comprised of experts in microlensing theory and analysis, software and algorithms. No panel member may participate in any of the teams and all panel members will be required to declare any conflicts of interest.
It is important to note that the philosophy driving this challenge aims to maximize innovation and problem-solving as well as participation in the field. Accurately modeling large numbers of events in good time is of course highly important, but tackling outstanding challenges in the analysis is also valuable. For example, entries which complete a limited analysis (e.g. a subset of lightcurves or parameters) but which explore/develop innovative approaches are welcome.
Note that in the simulated data, the inertial frame of reference is defined with the x-axis increasing from the binary center of mass towards the less massive lens at t0, the time of closest approach to the center of mass. If viewed from the solar system barycenter, the inertial frame moves at the relative velocity vlens_CoM – vobserver(t0). The inclination of the orbit is a counter-clockwise rotation about the x-axis. α is the angle that the source trajectory makes with the x-axis (if parallax was 0). Where finite source effects are significant, a linear limb darkening law has been applied.
There will be two lightcurve files for each event or star, representing the data from WFIRST's W149 and Z087 filters. The files are in ASCII format with the columns:
BJD Aperture_Magnitude Error
and will follow the file-naming convention: ulwdc1_nnn_[W149/Z087].txt
wfirst_ephemeris.txt contains the BJD and 3-d spacecraft location within the solar system. The release will also include the surface-brightness color relation for Z087-W149 to enable lens masses to be determined where applicable. Data releases will be made through the data challenges Github organization.
A public data challenge github organization has been set-up for all entrants to use, and will be where the challenge datasets can be downloaded from.Forming/joining a team
If you would like to join a team, or wish to recruit members for one, the Github organization has a project to help you make contact with other interested people: data challenge team project
Teams are strongly encouraged to set up their own Teams within this Github organization, and to use its repository, wiki and issue-tracking capabilities: start a data challenge teamAccessing the Challenge Dataset
The first data challenge dataset are now available for download.
Entrants first need to email rstreet [at] lco.global and request to join the organization in order to gain access.
In the interests of transparency, all questions regarding the data challenge should be posted as a discussion thread to the data challenge organizer team . This then allows everyone to see the answers - after all, if its confusing you, its probably confusing someone else as well.
Everyone interested in the progress of the data challenge is strongly encouraged to sign up to our mailing list. In particular, this list will be used to announce data releases and any necessary changes.
In an ideal world, all entries would be compared by an identical set of independent and purely numerical metrics. This is difficult in practice because of a range of factors – for instance, it is impractical to expect teams to run their analysis on the same hardware and we don't wish to limit collaboration by proscribing a fixed number of team members. We therefore ask all teams to provide a common set of numerical metrics together with a broader description of their approach.
The emphasis of the challenge is on developing novel approaches and techniques to modeling microlensing lightcurves, rather than the shear numbers of events analyzed. For example, the evaluation panel will favorably consider entries which tackle certain aspects of the modeling with a new approach, even if not all of the lightcurves are analyzed, or some data products are missing.
A detailed description of the preferred contents of entries can be found here
The deadline for entries to the first data challenge is Oct 31, 2018 at 23:59 UTC. A link to the submission portal will be provided from this data challenge website, to which you will be able to upload a tarball of all associated files. The tarball should be prefixed with the lead investigator's or team name in order to distinguish it.
All submissions will be judged by a panel selected for their experience in microlensing theory, statistics and software, and who did not actively participate in a submitting team.
All submissions will be anonymized (the “team.dat” file will be removed) during the evaluation to minimize unconscious bias.
Entries will be judged quantitatively against the input parameters of the simulations, but there will be no ranking of entries. Entries determined to be serious at the discretion of the judging panel will
a) entitle all team members to co-authorship on a paper summarizing the results of the data challenge to be submitted to a peer reviewed journal,
b) imply consent for the entry's methods to be summarized and its results discussed quantitatively and qualitatively in the summary paper.
Teams will be identified with their submissions in this paper. Note, however, that we are just as interested in varying degrees of failure as well as success, and these will be discussed in a fair and constructive manner in the paper.
Teams are also encouraged to publish independent papers describing their methods in detail.