Volume 11 Number 4 (Jul. 2016)
Home > Archive > 2016 > Volume 11 Number 4 (Jul. 2016) >
JCP 2016 Vol.11(4): 341-352 ISSN: 1796-203X
doi: 10.17706/jcp.11.4.341-352

Improvement of Agent Learning for a Card Game Based on Multi-channel ART Networks

Kenta Nimoto, Kenichi Takahashi, Michimasa Inaba
Graduate School of Information Sciences Hiroshima City University, Hiroshima, Japan.
Abstract—The 3-channel fuzzy adaptive resonance theory network FALCON (Fusion Architecture for Learning, COgnition, and Navigation) is recognized as an effective method for combining reinforcement learning with state segmentation, in which learning targets the relationships between percepts, actions, and rewards. It has been shown that FALCON is effective in making a playing agent for the card game Hearts, although the agent was unable to beat a rule-based agent. This study proposes new learning methods for training FALCON, in order to create a stronger agent. Using percepts chosen with an emphasis on penalty points, actions to choose which specific card to play were selected, with feedback determined by the penalty points. The learning rate for updating weights was changed so that its value was determined based on the penalty points. Separate strategies were adopted for the lead player and the other players, and multiple FALCONs were employed to improve adaptation to the game situation. Experiments demonstrated that our approach is superior to a rule-based approach.

Index Terms—FALCON, hearts, multi-channel adaptive resonance theory networks, reinforcement learning.

[PDF]

Cite: Kenta Nimoto, Kenichi Takahashi, Michimasa Inaba, "Improvement of Agent Learning for a Card Game Based on Multi-channel ART Networks," Journal of Computers vol. 11, no. 4, pp. 341-352, 2016.

General Information

ISSN: 1796-203X
Abbreviated Title: J.Comput.
Frequency: Bimonthly
Editor-in-Chief: Prof. Liansheng Tan
Executive Editor: Ms. Nina Lee
Abstracting/ Indexing: DBLP, EBSCO,  ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat,etc
E-mail: jcp@iap.org
  • Nov 14, 2019 News!

    Vol 14, No 11 has been published with online version   [Click]

  • Mar 20, 2020 News!

    Vol 15, No 2 has been published with online version   [Click]

  • Dec 16, 2019 News!

    Vol 14, No 12 has been published with online version   [Click]

  • Sep 16, 2019 News!

    Vol 14, No 9 has been published with online version   [Click]

  • Aug 16, 2019 News!

    Vol 14, No 8 has been published with online version   [Click]

  • Read more>>