What problems deserve the best researchers and engineers alive?
What are the important problems of your field? What important problems are you working on? If what you are doing is not important, and if you don’t think it is going to lead to something important, why are you working on it?— Richard HammingI think all of the following problems are worth solving and we need someone to work on them. This doesn’t want to draw a line between things we should do and things we shouldn’t do. This is an attempt to figure out:
what problems deserve the best researchers and engineers alive?
Problems that I believe to be important and pivotal for humanity include:
- Better Reinforcement Learning: learning from explanations, not millions of examples
- LLMs + traditional/better RL (not RLHF): what if you fine-tune an LLM to be a chess master in an RL fashion and as a side effect it becomes a superhuman genius in something else? Repeat WLOG for every problem where traditional/better RL can be applied, and strive to figure out ways to reformulate problems so traditional RL can be applied
- Level 5 Self-driving: it must not be fun to drive trucks around all day, especially if you can’t come back home to your family at night — see also the following bullet point
- Generative Vision / Robotics: Solving level 5 self-driving and/or generative vision potentially also gets us a good general physics simulator as a side effect, which can then be used to do reinforcement learning on more robotics tasks. The impact of each of these problems would compound far further and contribute to solving the other pivotal problems as you can see.
- Bioengineering: solving diseases. This is fundamentally just information science, where the rest of techniques apply. Nothing new. It’s still worth remarking and being included here because this application is timeless and important enough regardless of techniques
- Laziness / Attention span: the human attention span decrease is the saddest loss of this decade. This can both lead towards slowing down productivity and innovation as well as cutting individual’s ability to enjoy life and human consciousness as a whole. It also makes us optimize for the wrong lazy objectives, addictive infinite scrolling feeds may be just the beginning
- Climate change: yes, we don’t have enough data and are not too sure about this, exactly because of this uncertainty, we should move as if the worst forecasts will become true.
On the other hand, problems that may be cool but I don’t believe to be pivotal or worth of pursuing as much as the former include:
- AI application/system-level efficiency (retrieval tricks, orchestration, use case-specific wrappers): the iPhone interface was so good it stayed the same for years. The chat interface, similarly, is so good that will stay until the next innovation of similar impact. Nothing pivotal here. Yes, it is necessary to integrate AI to improve the efficiency of as many fields as possible, and it is the right thing to do. Is it worth the best researchers/engineers of the decade? No.
- AR/VR: cool, impressive, but what difference will it make? And will it be net positive or net negative? Is it worth the best researchers/engineers of the decade?
- Brain-Computer Interfaces: the computer keyboard is completely fine. This is just good for accessibility.
- Interplanetary quests: this is of course interesting but all the former problems, if solved, would make this easy.
I’m just a young student. Correct me if I’m wrong at hello at danielfalbo dot com.