I have discovered that in the new test set, that was published recently, the new cards are presented, that are not mentioned in the train set.
Is this an intended situation, or a bug? Due to so many new cards, it may be considered as completely different games in the train and the test set, so I doubt the result can be estimated.
These cards are presented in the train set, but not in the test:
Excess Mana
Frog
Mind Blast
Polymorph
Sheep
These cards are in the test set, but not in the train set (28 of them!):
Ancestral Healing
Arcane Explosion
Arcane Missiles
Booty Bay Bodyguard
Core Hound
Dire Wolf Alpha
Dragonling Mechanic
Fen Creeper
Frost Nova
Frostwolf Grunt
Goldshire Footman
Lord of the Arena
Magma Rager
Mana Tide Totem
Mechanical Dragonling
Mind Control
Mogu'shan Warden
Nightblade
Northshire Cleric
Raid Leader
Sap
Shieldbearer
Silverback Patriarch
Stormwind Knight
Succubus
Voidwalker
Warsong Commander
Wolfrider
Hello,
yes, the test data contains game states from completely new games. They were played using an extended set of cards but not entirely different in comparison to the decks in the training data (these decks were also used).
We believe that using an extended set of decks in the test set better reflects the real-life situation, thus it is more suitable for this challenge.
Best,
Andrzej Janusz