2014 Rules

The 2014 AAAI Computer Poker Competition will have one heads-up limit competition, two heads-up no-limit competitions, and two 3-player ring limit competitions.

If you have comments or suggestions, please post to the forums in the rules discussion section.

This year we will have the following competitions:

  • Total bankroll heads-up limit Texas Hold'em competition
  • Total bankroll and instant run-off no limit Texas Hold'em competitions
  • Total bankroll and instant run-off 3-player ring limit Texas Hold'em competitions
  • Total bankroll 3-player Kuhn competition

The basic rules for this year's events will be mostly unchanged from last year, with a few notable exceptions.  First, the 3-player events will have 3000 hand matches, like the events in both 2-player divisions.  Second, in no-limit we will average across all future board cards when both players go all-in.  Much of the variance in no-limit comes from the randomly drawn future board cards at all-in showdowns.  Using the average of all possible future outcomes allows us greatly reduce the variance, and thus we can compute more accurate results in fewer hands.  Finally, the largest change is the elimination of the heads-up limit instant run-off event.  One-on-one play in an instant run-off competition does not correspond well to exploitability, the proper measurement of how close to an equilibrium a strategy is.  With improvements in hardware and algorithms, it is now reasonable to directly measure exploitability heads up limit.  Combined with a greatly expanded field of high-quality instant run-off entries, the ACPC 2-player limit instant run-off competition now is of questionable value given the increasing amount of resources that it requires.  Like last year, we will be seeding the 2-player limit competition with some intentionally weak bots ("chumps") to provide an incentive for bots to try exploiting other players.

Teams may enter one agent per competition (i.e., one agent for each winner determination rule in each of the three game divisions). By default, if a team submits only one agent to a division with both a total bankroll and instant run-off event, then it will be entered into both competitions for that division. Teams may opt-out of this if they wish, but the competition would like to encourage as many entries as possible in all competitions. The winner of a competition will be determined by matches between bots that were submitted to that specific competition.

We will use the same server code as the last few years: ACPC 2011 Server Code. The protocol remains unchanged. Please check the technical details page for agent implementation details.

Advancing our Objective

Pursuant to the competition objective, the details of each hand will be made completely public and available to anyone who wants to view them. This includes cards (both the community cards and each agent's hole cards, regardless of whether the hand made it to showdown), betting sequences, and so forth.

We will endeavor to make a benchmark server available after the competition. With this server, agents will be available to test against (for teams who competed in 2014), but the code will not be available to download. This will help competitors try alternative techniques to find out how they would have done.

Finite Computational Resources

Unfortunately we only have a limited amount of computing time available to generate the results for this year's competition. If we have insufficient resources to evaluate all pairs of competitors in a given competition, then we may need to take measures to ensure we get sufficient data to properly evaluate the competition. This will likely take the form of a reduced number of matches between some combinations of entrants.  We will compute a round robin using all the competitors with a small number of matches to get an initial estimate of agent performance. Top agents based on these initial results will then be given further computation time.

Heads-up Limit Texas Hold'em

Details of the event rules are listed below. Please see the links for further details of this particular variant.

Game Limit Texas Hold'em
Competition Format Series of heads-up duplicate matches
Hands Per Match 3000
Stack Sizes Infinite
Bet Sizes 10/20
Blind Sizes 5/10
Blind Structure Reverse blinds, no ascending blinds
Showdown Mucking No
Illegal Actions

Any illegal action is interpreted as a call.

Winner Determination

total bankroll.

Heads-up No-limit Texas Hold'em

Details of the event rules are listed below. Please see the links for further details of this particular variant.

Game No-Limit Texas Hold'em (Doyle's Game)
Competition Format Series of heads-up duplicate matches
Hands Per Match 3000
Stack Sizes 200 big blinds (400 small blinds)
Bet Sizes No limit
Blind Sizes 50/100
Blind Structure Reverse blinds, no ascending blinds
Showdown Mucking No
Illegal Actions

Any illegal action is interpreted as a call if raise is illegal. If it is a raise for an illegal amount, it is interpreted as the closest possible raise amount.

Winner Determination

Bankroll instant run-off and total bankroll

Ring Limit Texas Hold'em

In both 3 player competitions all entrants will play at least one match against every possible combination of opponents. This means there will be m choose 3 matches, where m is the number of entrants. Unless there is an abundance of computing resources available there will be only one match per configuration. This is to give the maximum number of hands possible in between each memory reset (as described in the duplicate section above) for opponent modeling purposes. Likely this will still result in less hands in between each memory reset than in the two player competitions.

Details of the event rules are listed below. Please see the links for further details of this particular variant.

Game 3 player ring Limit Texas Hold'em
Competition Format Series of 3-player duplicate matches
Hands Per Match 3000
Stack Sizes Infinite
Bet Sizes 10/20
Blind Sizes 5/10
Blind Structure No ascending blinds
Showdown Mucking No
Illegal Actions

Any illegal action is interpreted as a call.

Winner Determination

Bankroll instant run-off and total bankroll

3-player Kuhn Poker

Details of the event rules are listed below. Please see the links for further details of this particular variant.

Game Limit Kuhn Poker
Competition Format Series of 3-player duplicate matches
Hands Per Match 3000
Stack Sizes Infinite
Bet Size 1 chip
Ante Size 1 chip
Showdown Mucking No
Illegal Actions

Any illegal action is interpreted as a check/call.

Winner Determination

total bankroll.

Arbitration

If collusion or abuse of the network is detected, a Chair will present the issue to the arbiter of the competition (to be determined). In such cases, the arbiter's decision will be final. Abuse of the network is defined as any ethernet traffic that is not a communication of actions to the server. Collusion is cooperation between agents.

Agents that crash during matches may be disqualified from the competition at the discretion of the chairs in consultation with the arbiter. The rationale for this rule is that a high degree of variance could be injected into the total bankroll competitions if an agent crashes frequently against some opponents but not others.

Card Generation

The teams will collaborate to generate cards. Specifically, seeds from each team will be used to compose the random number seeds for the competition.