v0.6.3

What's Changed

• Fix neg_half by @AntonOresten in #4

New Contributors

• @AntonOresten made contribution in #4

Full Changelog: v0.6.2...v0.6.3

v0.6.2

PositionalEmbeddings v0.6.2

Diff since v0.6.1

Exclude LinearAlgebra compat and relax CUDA compat.

v0.6.1

PositionalEmbeddings v0.6.1

Diff since v0.6.0

Relax LinearAlgebra default compat that was set automatically.

v0.6.0

Full Changelog: v0.5.0...v0.6.0

v0.5.0

Full Changelog: v0.4.0...v0.5.0

v0.4.0

PositionalEmbeddings v0.4.0

Diff since v0.2.0

Make compat less strict.

v0.3.0

PositionalEmbeddings v0.3.0

Update to match reference implementation from https://github.com/labmlai/annotated_deep_learning_paper_implementations/blob/master/labml_nn/transformers/rope/

Merged pull requests:

• build(deps): bump codecov/codecov-action from 4 to 5 (#1) (@dependabot[bot])

Closed issues:

• TagBot trigger issue (#2)

v0.2.0

PositionalEmbeddings v0.2.0

Fix RoPE neg_half to correctly work with pairs.

Merged pull requests:

• build(deps): bump codecov/codecov-action from 4 to 5 (#1) (@dependabot[bot])