FANN + Reinforcement Learning: Incorporating Eligibility Traces

[Iordanis Daroglou]

Hello people,

I'm working on a project for my thesis, and I'm cosnidering to use FANN
for implementing NN-based function approximation.
Still, I'm confused on how I should integrate eligibility traces with
FANN. Any ideas, or even snippets of code, would be much appreciated!

Greetings,
Iordanis

[Steffen Nissen]

Hi Lordanis,

Please take a look at my thesis "Large Scale Reinforcement Learning using
Q-SARSA(ë) and Cascading Neural Networks"
http://leenissen.dk/rl/Steffen_Nissen_Thesis2007_Hyper.pdf

Which does exactly this.

There is full source available here:
http://leenissen.dk/rl/src.tgz

Best Regards,
Steffen Nissen, MSc
http://www.linkedin.com/in/steffennissen

Post by Iordanis Daroglou
Hello people,
I'm working on a project for my thesis, and I'm cosnidering to use FANN
for implementing NN-based function approximation.
Still, I'm confused on how I should integrate eligibility traces with
FANN. Any ideas, or even snippets of code, would be much appreciated!
Greetings,
Iordanis
------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Fann-general mailing list
https://lists.sourceforge.net/lists/listinfo/fann-general

[Iordanis Daroglou]

Thanks for your fast response, Steffen.

I'll check out your thesis, as well as the relevant sources.
Thanks for sharing it in the first place, anyway :)

Greetings,
Iordanis

Post by Steffen Nissen
Hi Lordanis,
Please take a look at my thesis "Large Scale Reinforcement Learning
using Q-SARSA(λ) and Cascading Neural Networks"
http://leenissen.dk/rl/Steffen_Nissen_Thesis2007_Hyper.pdf
Which does exactly this.
http://leenissen.dk/rl/src.tgz
Best Regards,
Steffen Nissen, MSc
http://www.linkedin.com/in/steffennissen