<p>This web site hosts the various downloads available from the <ahref="https://eclipse.org/scava">Eclipse Scava project</a>. It notably includes:</p>
<p>This web site hosts the open datasets generated in the course of the <ahref="https://crossminer.org">Crossminer research project</a>. Crossminer has been terminated in 2019, and since then the datasets are maintained by <ahref="https://castalia.solutions">Castalia Solutions</a> as a service for the Eclipse and Research communities.</p>
<p>The datasets include various pieces of data retrieved from the Eclipse forge: Mailing lists, Project development data, and AERI stacktraces in handy CSV and JSON formats, and each dataset has a R Markdown document describing its content and providing hints about how to use it. Examples provided mainly use the <ahref="https://r-project.org">R statistical analysis software</a>.</p>
<p>All datasets are published under the <ahref="https://creativecommons.org/licenses/by-sa/4.0/">Creative Commons BY-Attribution-Share Alike 4.0 (International)</a>.</p>
<p>All data is anonymised, please see the <ahref="datasets_privacy.html">dedicated document</a> to learn more about privacy and the anonymisation mecanism.</p>
<p>We're open: if you'd like to contribute, please see the <ahref="https://gitlab.eclipse.org/bbaldassari2kd/scava-datasets">GitLab project</a> page.</p>
<li>Licencing and copyrights (<ahref="https://github.com/nexB/scancode-toolkit">Scancode</a>), and</li>
<li>Static Code Analysis (<ahref="https://sonarcloud.io">SonarCloud</a>) when available.</li>
</ul>
<p>These datasets are updated weekly, at 2am on Sunday. If you would like to add a project, please <ahref="https://gitlab.eclipse.org/bbaldassari2kd/scava-datasets/-/issues">let us know</a>.</p>
<p><strong>Downloads</strong></p>
<ul>
<li><strong>List of projects</strong> See the <ahref="projects/eclipse_projects.html">list of projects with their associated datasets and documentation</a>.</li>
<p>The <ahref="eclipse_mls/eclipse_mls.html">Eclipse Mailing lists</a> dump is an extract of all emails posted on the Eclipse mailing lists.</p>
<ul>
<ul>
<li>Open <ahref="datasets/index.html">software-engineering datasets</a> related to the Eclipse forge, including AERI stacktraces, Eclipse mailing lists, and Eclipse projects data.</li>
<li>Download the <strong>Eclipse mailing lists dataset</strong> [ <ahref="eclipse_mls/eclipse_mls.gz">CSV</a> ].</li>
<li>Downloads for the Scava application (availability planned for Q3 2019).</li>
<li>Check the <strong>documentation</strong> for the dataset <ahref="eclipse_mls/mbox_csv_analysis.html">here (HTML)</a>. For reproducibility we also provide the <ahref="eclipse_mls/mbox_csv_analysis.rmd">R Markdown document</a> for the dataset analysis and documentation.</li>
<li>Download the <strong>mbox files</strong> [ <ahref="eclipse_mls/eclipse_mls.html#project-mboxes">see the list</a> ]</li>
<p>The <ahref="aeri_stacktraces/aeri_stacktraces.html">AERI stacktraces dataset</a> is a list of exceptions encountered by users in the Eclipse IDE, as retrieved by the AERI system. The Automated Error Reporting (AERI) system has been developed by the people at <ahref="https://www.codetrails.com/">Code Trails</a> and retrieves information about exceptions. It is installed by default in the Eclipse IDE and has helped hundreds of projects better support their users and resolve bugs. This dataset is a dump of all records over a couple of years, with useful information about the exceptions and environment.</p>
<p>Last update of the dataset occured on 2018-02-11.</p>
<p><strong>Downloads</strong></p>
<ul>
<li><strong>Problems full</strong> [ <ahref="aeri_stacktraces/problems_full.tar.bz2">Download JSON</a> ] -- A list of all problems, exported as JSON (one problem per file).</li>
<li><strong>Problems extract</strong> [ <ahref="aeri_stacktraces/problems_extract.csv.bz2">Download CSV</a> ] -- A list of all problems, exported as CSV (one big file).</li>
<li><strong>Incidents full</strong> [ <ahref="aeri_stacktraces/incidents_full.tar.bz2">Download JSON</a> ] -- A list of all incidents, exported as JSON (one incident per file).</li>
<li><strong>Incidents extract</strong> [ <ahref="aeri_stacktraces/incidents_extract.csv.bz2">Download CSV</a> ] -- A list of all incidents, exported as CSV (one big file).</li>
<li><strong>Incidents Bundles</strong> [ <ahref="aeri_stacktraces/incidents_bundles_extract.csv.bz2">Download CSV</a> ] -- A list of all bundles found in incidents, exported as CSV. Attributes are bundle_name, bundle_version, and number of occurrences.</li>
</ul>
<p><strong>Documentation</strong></p>
<ul>
<li><strong>Stacktraces Problems analysis document</strong> [ <ahref="aeri_stacktraces/problems_analysis.pdf">Download PDF</a> | <ahref="aeri_stacktraces/problems_analysis.rmd">Download Rmd</a> ] -- A R Markdown document to analyse the Stacktraces problem dataset, with description of the actual content and examples of usage.</li>
<li><strong>Stacktraces Incidents analysis document</strong> [ <ahref="aeri_stacktraces/incidents_analysis.pdf">Download PDF</a> | <ahref="aeri_stacktraces/incidents_analysis.rmd">Download Rmd</a> ] -- A R Markdown document to analyse the Stacktraces incidents dataset, with description of the actual content and examples of usage.</li>
</ul>
<p>More information about the AERI system can be found on the <ahref="https://www.codetrails.com/error-analytics/manual/">Code Trails website</a>.</p>
<p>All datasets are published under the <ahref="https://creativecommons.org/licenses/by-sa/4.0/">Creative Commons BY-Attribution-Share Alike 4.0 (International)</a>.</p>
<p>All datasets are published under the <ahref="https://creativecommons.org/licenses/by-sa/4.0/">Creative Commons BY-Attribution-Share Alike 4.0 (International)</a>.</p>
<p>All code is, unless otherwise stated, published under the <ahref="https://www.eclipse.org/legal/epl-2.0/">Eclipse Public Licence, v2</a>.</p>
<p>All code is, unless otherwise stated, published under the <ahref="https://www.eclipse.org/legal/epl-2.0/">Eclipse Public Licence, v2</a>.</p>
<p>More information can be found in the following places:</p>
<ul>
<li>The <ahref="https://github.com/eclipse-scava/scava-datasets">git repository dedicated to the datasets extraction</a>: <code>git@github.com:eclipse-scava/scava-datasets.git</code></li>
<li>The <ahref="https://github.com/crossminer/scava-docs">documentation repository</a> for the Scava project: <code>https://github.com/crossminer/scava-docs</code></li>
<p>This web site hosts the open datasets generated in the course of the Crossminer research project. It includes various pieces of data retrieved from the Eclipse forge in CSV and JSON formats, and each dataset has a R Markdown document describing its content and providing hints about how to use it. Examples provided mainly use the <ahref="https://r-project.org">R statistical analysis software</a>.</p>
<p>All datasets are published under the <ahref="https://creativecommons.org/licenses/by-sa/4.0/">Creative Commons BY-Attribution-Share Alike 4.0 (International)</a>.</p>
<p>All data is anonymised, please see the <ahref="../docs/datasets_privacy.html">dedicated document</a> to learn more about privacy and the anonymisation mecanism.</p>
<p>These datasets are updated weekly, at 2am on Sunday.</p>
<p><strong>Downloads</strong></p>
<ul>
<li><strong>List of projects</strong> See the <ahref="projects/eclipse_projects.html">list of projects with their associated datasets and documentation</a>.</li>
<p>The <ahref="aeri_stacktraces/aeri_stacktraces.html">AERI stacktraces dataset</a> is a list of exceptions encountered by users in the Eclipse IDE, as retrieved by the AERI system. The Automated Error Reporting (AERI) system has been developed by the people at <ahref="https://www.codetrails.com/">Code Trails</a> and retrieves information about exceptions. It is installed by default in the Eclipse IDE and has helped hundreds of projects better support their users and resolve bugs. This dataset is a dump of all records over a couple of years, with useful information about the exceptions and environment.</p>
<p>Last update of the dataset occured on 2018-02-11.</p>
<p><strong>Downloads</strong></p>
<ul>
<li><strong>Problems full</strong> [ <ahref="aeri_stacktraces/problems_full.tar.bz2">Download JSON</a> ] -- A list of all problems, exported as JSON (one problem per file).</li>
<li><strong>Problems extract</strong> [ <ahref="aeri_stacktraces/problems_extract.csv.bz2">Download CSV</a> ] -- A list of all problems, exported as CSV (one big file).</li>
<li><strong>Incidents full</strong> [ <ahref="aeri_stacktraces/incidents_full.tar.bz2">Download JSON</a> ] -- A list of all incidents, exported as JSON (one incident per file).</li>
<li><strong>Incidents extract</strong> [ <ahref="aeri_stacktraces/incidents_extract.csv.bz2">Download CSV</a> ] -- A list of all incidents, exported as CSV (one big file).</li>
<li><strong>Incidents Bundles</strong> [ <ahref="aeri_stacktraces/incidents_bundles_extract.csv.bz2">Download CSV</a> ] -- A list of all bundles found in incidents, exported as CSV. Attributes are bundle_name, bundle_version, and number of occurrences.</li>
</ul>
<p><strong>Documentation</strong></p>
<ul>
<li><strong>Stacktraces Problems analysis document</strong> [ <ahref="aeri_stacktraces/problems_analysis.pdf">Download PDF</a> | <ahref="aeri_stacktraces/problems_analysis.rmd">Download Rmd</a> ] -- A R Markdown document to analyse the Stacktraces problem dataset, with description of the actual content and examples of usage.</li>
<li><strong>Stacktraces Incidents analysis document</strong> [ <ahref="aeri_stacktraces/incidents_analysis.pdf">Download PDF</a> | <ahref="aeri_stacktraces/incidents_analysis.rmd">Download Rmd</a> ] -- A R Markdown document to analyse the Stacktraces incidents dataset, with description of the actual content and examples of usage.</li>
</ul>
<p>More information about the AERI system can be found on the <ahref="https://www.codetrails.com/error-analytics/manual/">Code Trails website</a>.</p>
<p>The <ahref="eclipse_mls/eclipse_mls.html">Eclipse Mailing lists</a> dump is an extract of all emails posted on the Eclipse mailing lists.</p>
<ul>
<li>Download the <strong>Eclipse mailing lists dataset</strong> [ <ahref="eclipse_mls/eclipse_mls.gz">CSV</a> ].</li>
<li>Check the <strong>documentation</strong> for the dataset <ahref="eclipse_mls/mbox_csv_analysis.html">here (HTML)</a>. For reproducibility we also provide the <ahref="eclipse_mls/mbox_csv_analysis.rmd">R Markdown document</a> for the dataset analysis and documentation.</li>
<li>Download the <strong>mbox files</strong> [ <ahref="eclipse_mls/eclipse_mls.html#project-mboxes">see the list</a> ]</li>
</ul>
<p>More information can be found on the official <ahref="https://accounts.eclipse.org/mailing-list">Eclipse page for mailing lists</a>.</p>
This web site hosts the open datasets generated in the course of the Crossminer research project. It includes various pieces of data retrieved from the Eclipse forge in CSV and JSON formats, and each dataset has a R Markdown document describing its content and providing hints about how to use it. Examples provided mainly use the [R statistical analysis software](https://r-project.org).
All datasets are published under the [Creative Commons BY-Attribution-Share Alike 4.0 (International)](https://creativecommons.org/licenses/by-sa/4.0/).
All data is anonymised, please see the [dedicated document](../docs/datasets_privacy.html) to learn more about privacy and the anonymisation mecanism.
## Eclipse projects
We generate full data extracts of a [set of Eclipse projects](projects/eclipse_projects.html), including data sources like:
These datasets are updated weekly, at 2am on Sunday.
**Downloads**
***List of projects** See the [list of projects with their associated datasets and documentation](projects/eclipse_projects.html).
## AERI Stacktraces
The [AERI stacktraces dataset](aeri_stacktraces/aeri_stacktraces.html) is a list of exceptions encountered by users in the Eclipse IDE, as retrieved by the AERI system. The Automated Error Reporting (AERI) system has been developed by the people at [Code Trails](https://www.codetrails.com/) and retrieves information about exceptions. It is installed by default in the Eclipse IDE and has helped hundreds of projects better support their users and resolve bugs. This dataset is a dump of all records over a couple of years, with useful information about the exceptions and environment.
Last update of the dataset occured on 2018-02-11.
**Downloads**
***Problems full**[ [Download JSON](aeri_stacktraces/problems_full.tar.bz2) ] -- A list of all problems, exported as JSON (one problem per file).
***Problems extract**[ [Download CSV](aeri_stacktraces/problems_extract.csv.bz2) ] -- A list of all problems, exported as CSV (one big file).
***Incidents full**[ [Download JSON](aeri_stacktraces/incidents_full.tar.bz2) ] -- A list of all incidents, exported as JSON (one incident per file).
***Incidents extract**[ [Download CSV](aeri_stacktraces/incidents_extract.csv.bz2) ] -- A list of all incidents, exported as CSV (one big file).
***Incidents Bundles**[ [Download CSV](aeri_stacktraces/incidents_bundles_extract.csv.bz2) ] -- A list of all bundles found in incidents, exported as CSV. Attributes are bundle_name, bundle_version, and number of occurrences.
**Documentation**
***Stacktraces Problems analysis document**[ [Download PDF](aeri_stacktraces/problems_analysis.pdf) | [Download Rmd](aeri_stacktraces/problems_analysis.rmd) ] -- A R Markdown document to analyse the Stacktraces problem dataset, with description of the actual content and examples of usage.
***Stacktraces Incidents analysis document**[ [Download PDF](aeri_stacktraces/incidents_analysis.pdf) | [Download Rmd](aeri_stacktraces/incidents_analysis.rmd) ] -- A R Markdown document to analyse the Stacktraces incidents dataset, with description of the actual content and examples of usage.
More information about the AERI system can be found on the [Code Trails website](https://www.codetrails.com/error-analytics/manual/).
## Eclipse mailing lists
The [Eclipse Mailing lists](eclipse_mls/eclipse_mls.html) dump is an extract of all emails posted on the Eclipse mailing lists.
* Download the **Eclipse mailing lists dataset**[ [CSV](eclipse_mls/eclipse_mls.gz) ].
* Check the **documentation** for the dataset [here (HTML)](eclipse_mls/mbox_csv_analysis.html). For reproducibility we also provide the [R Markdown document](eclipse_mls/mbox_csv_analysis.rmd) for the dataset analysis and documentation.
* Download the **mbox files**[ [see the list](eclipse_mls/eclipse_mls.html#project-mboxes) ]
More information can be found on the official [Eclipse page for mailing lists](https://accounts.eclipse.org/mailing-list).
