-
Couldn't load subscription status.
- Fork 42
Closed as not planned
Labels
Description
Hi Team,
First, I want to express my appreciation for maintaining this repository and fla. I'm finding both projects very valuable.
I have several questions about the project:
-
Project Status
- Is this repository actively being developed?
- Are you accepting external contributions?
-
Development Direction
- If external contributions are welcome, could you share your roadmap?
- I'd be interested in contributing based on the project's goals.
-
Technical Architecture
From my understanding:- The project uses
flafor model definition - Training is handled by torchtitan
- Given
fla's HuggingFace compatibility, it should work withlm-eval-harnessfor evaluation
Could you confirm if this understanding is correct?
- The project uses
-
Future Plans
- Are there plans to extend into post-training scenarios?
- If so, open-instruct could be a valuable reference point.
Looking forward to your response and potentially contributing to the project.
Best regards