feat/tf_support #37

Merged

Fabel merged 13 commits from feat/tf_support into develop 2025-04-16 20:59:48 +00:00

Conversation 0 Commits 13 Files Changed 13 +184 -353

Fabel commented 2025-04-16 20:59:44 +00:00

Owner

Copy Link

added transformer support

added transformer support

Fabel added 13 commits 2025-04-16 20:59:45 +00:00

0852ddb109 removed the chunked and recursive model, since they are now depreacted. for the transfomer switch I decided to focus on my idea with Sparse Mixutre of Experts with shared Params.

040ac478b9 removed loading and saving functions since tf will take over

bf915a4dca added transformers to requirements

d4db1ef116 updated tests for transfomer switch

30695154b4 removed depcreated models from init files

22e5d0023e updated pretrainer to feature PreTrainedModel

ba6da9ef02 restored full example

a8ddf2b559 updated config to not handle ustom model_name; removed ln rate and made it transformer compatible

3e78a595c9 removed base aiia class and replaced it with transformer support

9ec01e2dd0 tests with new config

023ca07cf7 tests to pass new params

1190f3c05f updated config to match new version

716f6e2470 increased version number

Fabel merged commit 674e5d5409 into develop 2025-04-16 20:59:48 +00:00

Fabel referenced this issue from a commit 2025-04-16 20:59:49 +00:00

Merge pull request 'feat/tf_support' (#37) from feat/tf_support into develop

Fabel deleted branch feat/tf_support 2025-04-16 20:59:50 +00:00

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No Label

Milestone

Clear milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

No Assignees

1 Participants

Notifications

Subscribe

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Machine-Learning/AIIA#37

No description provided.