SELF-DISCOVER is a novel framework as an Android and Windows app that enables LLMs to self-discover and compose atomic reasoning modules
https://github.com/progressionnetwork/SelfDiscover/tree/main
SelfDiscover
SELF-DISCOVER is a novel framework as an Android and Windows app that enables LLMs to self-discover and compose atomic reasoning modules, such as critical thinking and step-by-step reasoning, to tackle complex reasoning problems.
Project Summary:
SELF-DISCOVER is a groundbreaking framework that revolutionizes LLM reasoning by enabling them to self-discover and compose reasoning modules. This project has the potential to significantly enhance the capabilities of LLMs, making them more adept at tackling complex reasoning problems.
SELF-DISCOVER: Empowering LLMs with Self-Directed Reasoning
Screenshots:
Key Features
- Groq & OpenAI API support
- gpt-3.5-turbo, gpt-4.0o, llama3-8b-8192, mixtral-8x7b-32768, gemma-7b-it models support.
- Multilingual tasks.
- Set your APIs in settings window.
- Support both Windows and Android.
- Basic answer: Utilizes regular answer for a given question.
- Self-Discover Agent: Execute an agent with chain of prompts to enable reasoning deeper for LLMs to get more advanced and proper answers.
- GPT Agent: Not-ready-yeat a full researcher agent with web scrapting and chain of prompts to make advanced researcher for a given task.
- Copy and share: Copy and share final result of model's answer.
- Export functionality: Saves result to a PDF.
Problem: Large Language Models (LLMs) struggle with complex reasoning tasks, often failing to break down problems into manageable steps and apply critical thinking. Traditional prompting methods like Chain-of-Thought (CoT) rely on implicit reasoning, limiting their effectiveness.
Solution: SELF-DISCOVER is a novel framework that enables LLMs to self-discover and compose atomic reasoning modules, such as critical thinking and step-by-step reasoning, to tackle complex reasoning problems. This framework empowers LLMs to:
- Explicitly identify and select relevant reasoning modules.
- Compose these modules into a task-unique reasoning structure.
- Follow this structure during decoding, leading to improved reasoning performance.
Key Features:
- Self-Discovery: LLMs actively identify and select relevant reasoning modules based on the task at hand.
- Reasoning Structure Composition: Modules are combined into a structured approach, providing a clear roadmap for the LLM's reasoning process.
- Enhanced Reasoning Capabilities: SELF-DISCOVER significantly improves LLMs' performance on challenging reasoning benchmarks, outperforming existing methods.
- Compute Efficiency: The framework requires significantly less computational resources compared to inference-intensive methods.
- Generalization: Reasoning structures discovered by powerful LLMs can be applied to smaller models, enhancing their reasoning abilities.
Reasoning Modules:
- How could I devise an experiment to help solve that problem?
- Make a list of ideas for solving this problem, and apply them one by one to the problem to see if any progress can be made.
- How can I simplify the problem so that it is easier to solve?
- What are the key assumptions underlying this problem?
- What are the potential risks and drawbacks of each solution?
- What are the alternative perspectives or viewpoints on this problem?
- What are the long-term implications of this problem and its solutions?
- How can I break down this problem into smaller, more manageable parts?
- Critical Thinking: This style involves analyzing the problem from different perspectives, questioning assumptions, and evaluating the evidence or information available. It focuses on logical reasoning, evidence-based decision-making, and identifying potential biases or flaws in thinking.
- Try creative thinking, generate innovative and out-of-the-box ideas to solve the problem. Explore unconventional solutions, thinking beyond traditional boundaries, and encouraging imagination and originality.
- Use systems thinking: Consider the problem as part of a larger system and understand the interconnectedness of various elements. Focus on identifying the underlying causes, feedback loops, and interdependencies that influence the problem, and developing holistic solutions that address the system as a whole.
- Use Risk Analysis: Evaluate potential risks, uncertainties, and trade-offs associated with different solutions or approaches to a problem. Emphasize assessing the potential consequences and likelihood of success or failure, and making informed decisions based on a balanced analysis of risks and benefits.
- What is the core issue or problem that needs to be addressed?
- What are the underlying causes or factors contributing to the problem?
- Are there any potential solutions or strategies that have been tried before? If yes, what were the outcomes and lessons learned?
- What are the potential obstacles or challenges that might arise in solving this problem?
- Are there any relevant data or information that can provide insights into the problem? If yes, what data sources are available, and how can they be analyzed?
- Are there any stakeholders or individuals who are directly affected by the problem? What are their perspectives and needs?
- What resources (financial, human, technological, etc.) are needed to tackle the problem effectively?
- How can progress or success in solving the problem be measured or evaluated?
- What indicators or metrics can be used?
- Is the problem a technical or practical one that requires a specific expertise or skill set? Or is it more of a conceptual or theoretical problem?
- Does the problem involve a physical constraint, such as limited resources, infrastructure, or space?
- Is the problem related to human behavior, such as a social, cultural, or psychological issue?
- Does the problem involve decision-making or planning, where choices need to be made under uncertainty or with competing objectives?
- Is the problem an analytical one that requires data analysis, modeling, or optimization techniques?
- Is the problem a design challenge that requires creative solutions and innovation?
- Does the problem require addressing systemic or structural issues rather than just individual instances?
- Is the problem time-sensitive or urgent, requiring immediate attention and action?
- What kinds of solutions typically are produced for this kind of problem specification?
- Given the problem specification and the current best solution, have a guess about other possible solutions.
- Let’s imagine the current best solution is totally wrong, what other ways are there to think about the problem specification?
- What is the best way to modify this current best solution, given what you know about these kinds of problem specification?
- Ignoring the current best solution, create an entirely new solution to the problem.
- Let’s make a step-by-step plan and implement it with good notation and explanation.
Application:
The SELF-DISCOVER framework can be integrated into various applications, including:
- Reasoning-based chatbots: Empowering chatbots to handle more complex user queries and provide more insightful responses.
- Question answering systems: Improving the accuracy and comprehensiveness of answers to complex questions.
- Decision-making tools: Assisting users in making informed decisions by providing structured reasoning and analysis.
Impact:
SELF-DISCOVER has the potential to significantly advance the field of natural language processing by enabling LLMs to perform more complex reasoning tasks. This will lead to more sophisticated and intelligent applications that can better understand and respond to human needs.
Contributions are welcome! If you find any issues or have suggestions for improvements, please open an issue or submit a pull request.
This project is licensed under the MIT License - see the LICENSE file for details.
If you have any questions, feel free to contact us on telegram @uberwow.