-
Seize the Interval
- explore when have time to use the resulting knowledge and exploit when ready to cash in
- Exploitation phase means the end of the interval?? 亏则盈,满则溢?
-
Win-stay Lose-shift
- Lose shift strategy is rather rough: good options shouldnt be penalized too strongly for being imperfect, 完美主义者来学学。。。。。
- doesnt take into account of the interval
- endless opportunities to try out, no exact solution
-
The Gittins Index
- Assumption: Geometric Discounting
-
Regret and Optimism
-
pick the option with the highest UCB
-
dont care the historical record
- choose the one with possible highest return in the future
-
Upper bound confidence
- optimism in the face of uncertainty
-
CONCLUSION
- In the long run, optimism is the best prevention for regrets
- to assume the best of them, in absence of evidence to the contrary
- 问题:如果一旦出现相反的例子该怎么办呢?
-
Baddits Online
-
A/B testing
- optimal way of balance exploration/exploition ??
-
Clinical Trials on Trial
- multi-armed bandit 算法在临床试验应用里的争议
-
The Restless World
- 如何理解: 对于一个持续不断变化的世界来说,通过进化来调节本能并不一定有助于工业标准化时代???
- 题外延伸:专治选择困难症——bandit算法
-
Explore
- explore early on and exploit at a later stage, but sacrifixe the good lay-offs
- 在人生的早期阶段,尝试新的冒险的激进事物,
-
Exploit
- 听老人言 没错的,是要建立对事物的鉴赏水平和基本观念相似的基础上吧??
- honing social network down to the most meaningful relationships is the rational responce of having less time of enjoy them
- the anwser is to seize the interval