DS2022_first

2 years ago

First semester project for Decision Systems Course 2022/2023

This is the first project for students enrolled in the Decision System 2022/2023 course at the Faculty of Mathematics, Informatics, and Mechanics at the University of Warsaw.

Overview

The goal of this competition is to construct a scoring model for predicting winners in the Starcraft video game (https://starcraft.com/).

More detailed competition rules are given in Terms and Conditions.

The description of the data and evaluation metric is in the Task description section.

The deadline for sending submissions and scores is December 9, 2022.

Terms & Conditions

Participants of the challenge are obliged to follow the competition rules:

This challenge is organized by Andrzej Janusz (the Organizer) for students enrolled in the Decision System 2022/2023 course at the Faculty of Mathematics, Informatics, and Mechanics at the University of Warsaw.
The provided data sets are the property of the Organizer and the KnowledgePit platform. It is forbidden to share or redistribute provided data sets to any third party without explicit consent from the Organizer.
Participants can work individually or as a team consisting of maximally two persons. The teams need to be formed at the beginning of the challenge. Participants cannot change their teams.
Each team has a limited number of submissions - the limit is set to 100.
The number of submissions per day is limited to 10.
Participants can use data that was made available in the challenge - using any external resources is possible only after receiving explicit consent from the Organizer. Queries regarding external resources need to be issued through the competition forum.
It is strictly forbidden to hack the provided data or to exploit any unfair and unintended data leaks that can improve the solution score. All attempts at making predictions for any test instance using information extracted from other test instances will result in disqualification.
The deadline for submitting the solutions is December 9, 2022 (23:59 GMT). Late submissions will not be accepted.
Each team is obliged to provide a short report describing their final solution. The report must contain information such as the name of the team, the names of all team members, and a brief overview of the approach used. The description should explain all data preprocessing steps and model construction steps. It should be submitted in the KnowledgePit submission system by December 9, 2022 (23:59 GMT).
By enrolling in this competition, you grant the Organizer the right to process your submissions and reports for the purpose of evaluation and post-competition research.
The final project score will depend on the quality of the solution (the score obtained in the final evaluation), and on the quality of the submitted report.

Final results

Rank	Team Name	Is Report		Preliminary Score	Final Score	Submissions
1	Huta Katowice	True	True	0.6988	0.685700	20
2	drużyna1	True	True	0.6878	0.685500	24
3	O.W.C.A.	True	True	0.6786	0.684200	57
4	ff	True	True	0.6922	0.681600	14
5	bochniarz_pasnikowski	True	True	0.6749	0.681200	5
6	rzutowanie	True	True	0.6876	0.681200	32
7	CakeTeam	True	True	0.6670	0.679300	52
8	x	True	True	0.6975	0.679000	17
9	Łukasz_Niedźwiedzki_419328	True	True	0.6788	0.678000	7
10	Epoch_Batch	True	True	0.6862	0.677600	22
11	quozz	True	True	0.6963	0.677200	41
12	baseline	True	True	0.6558	0.674800	1
13	OA	True	True	0.6972	0.673800	30
14	ZERG RUSH	True	True	0.6883	0.669900	36
15	Nie_umiem_w_ML	True	True	0.6691	0.669500	9
16	Adam i Łukasz	True	True	0.6820	0.666400	19
17	zsw	True	True	0.6762	0.665300	16
18	Team name	True	True	0.6757	0.660100	5

Task description

The provided data describe fragments of Starcraft games played between two players on standard 1v1 maps. Each row in the data files describes approximately 1 minute of a game. The first column in the training data contains game IDs, and the second column is the decision - information about the game-winner. The third column indicates the game type - which of the three in-game races are fighting. The remaining columns contain characteristics describing the situation in the game map. Their meaning is reflected by their names.

The data tables are provided as two CSV files with the ',' (coma) separator sign. They can be downloaded after registration to the competition. Both files (training and test sets) have the same format but the GameID and decision columns are missing from the test data.

The evaluation metric will be AUC. During the competition, your solutions will be evaluated on a small fraction of the test set (10%), and your best preliminary AUC score will be displayed on the public Leaderboard. The final score of each team will be computed on the remaining 90% of the test data.

The submission format: the solutions need to be submitted as text files with predictions. The file should have exactly the same number of rows as the test data table. In each row, it should contain exactly one real number expressing the likeliness that the correct decision value for the corresponding test set instance is A. The deadline for sending submissions and reports is December 9, 2022.

Data files

Forum

This forum is for all users to discuss matters related to the competition. Good manners apply!

There is no topics in this competition.