Volume 11 Number 4 (Jul. 2016)
Home > Archive > 2016 > Volume 11 Number 4 (Jul. 2016) >
JCP 2016 Vol.11(4): 341-352 ISSN: 1796-203X
doi: 10.17706/jcp.11.4.341-352

Improvement of Agent Learning for a Card Game Based on Multi-channel ART Networks

Kenta Nimoto, Kenichi Takahashi, Michimasa Inaba
Graduate School of Information Sciences Hiroshima City University, Hiroshima, Japan.
Abstract—The 3-channel fuzzy adaptive resonance theory network FALCON (Fusion Architecture for Learning, COgnition, and Navigation) is recognized as an effective method for combining reinforcement learning with state segmentation, in which learning targets the relationships between percepts, actions, and rewards. It has been shown that FALCON is effective in making a playing agent for the card game Hearts, although the agent was unable to beat a rule-based agent. This study proposes new learning methods for training FALCON, in order to create a stronger agent. Using percepts chosen with an emphasis on penalty points, actions to choose which specific card to play were selected, with feedback determined by the penalty points. The learning rate for updating weights was changed so that its value was determined based on the penalty points. Separate strategies were adopted for the lead player and the other players, and multiple FALCONs were employed to improve adaptation to the game situation. Experiments demonstrated that our approach is superior to a rule-based approach.

Index Terms—FALCON, hearts, multi-channel adaptive resonance theory networks, reinforcement learning.

[PDF]

Cite: Kenta Nimoto, Kenichi Takahashi, Michimasa Inaba, "Improvement of Agent Learning for a Card Game Based on Multi-channel ART Networks," Journal of Computers vol. 11, no. 4, pp. 341-352, 2016.

General Information

ISSN: 1796-203X
Frequency: Monthly (2006-2014); Bimonthly (Since 2015)
Editor-in-Chief: Prof. Liansheng Tan
Executive Editor: Ms. Nina Lee
Abstracting/ Indexing: DBLP, EBSCO,  ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jcp@iap.org
  • Sep 13, 2018 News!

    Vol 13, No 10 has been published with online version   [Click]

  • Jan 04, 2019 News!

    Vol 14, No 1 has been published with online version   [Click]

  • Nov 20, 2018 News!

    Vol 13, No 12 has been published with online version 10 papers are published in this issue after peer review

  • Oct 22, 2018 News!

    Vol 13, No 11 has been published with online version, 10 papers are published in this issue after peer review

  • Aug 06, 2018 News!

    Vol 13, No 1-No 8 has been indexed by EI (Inspec)   [Click]

  • Read more>>