Code

feat: Integrate flash attention#853

Code

Merged

numb3r3 merged 24 commits intojina-ai:mainjina-ai/clip-as-service:mainfrom OrangeSodahub:integrate-flash-attentionOrangeSodahub/clip-as-service:integrate-flash-attentionCopy head branch name to clipboardNov 15, 2022

+156-1

Commits

Commits on Nov 9, 2022

• feat: add flash attention

  OrangeSodahub

  committed
  24deab4

  Copy full SHA for 24deab4

• fix: flash-attn dependency

  OrangeSodahub

  committed
  3cf73b1

  Copy full SHA for 3cf73b1

• fix: flash_attn dependency

  OrangeSodahub

  committed
  1e688b1

  Copy full SHA for 1e688b1

• fix: use cuda in flash_attn

  OrangeSodahub

  committed
  3537eb2

  Copy full SHA for 3537eb2

• fix: import flash_attn

  OrangeSodahub

  committed
  d1fca64

  Copy full SHA for d1fca64

• fix: errors with batch_size > 1

  OrangeSodahub

  committed
  380b93c

  Copy full SHA for 380b93c

• fix: remove use_flash

  OrangeSodahub

  committed
  ba0c667

  Copy full SHA for ba0c667

Commits on Nov 10, 2022

• fix: optimize shape operation

  OrangeSodahub

  committed
  cfecdeb

  Copy full SHA for cfecdeb

• fix: add causal mask

  OrangeSodahub

  committed
  234447c

  Copy full SHA for 234447c

• fix: flash attention import

  OrangeSodahub

  committed
  ec100c4

  Copy full SHA for ec100c4

• fix: setup.py

  OrangeSodahub

  committed
  c9383cf

  Copy full SHA for c9383cf

• fix: flash attention import

  OrangeSodahub

  committed
  5cedb3d

  Copy full SHA for 5cedb3d

Commits on Nov 11, 2022

• fix: test ci

  OrangeSodahub

  committed
  0ed3c3a

  Copy full SHA for 0ed3c3a

• fix: test ci

  OrangeSodahub

  committed
  99aa3f3

  Copy full SHA for 99aa3f3

• fix: test ci

  OrangeSodahub

  committed
  069d851

  Copy full SHA for 069d851

• fix: test ci

  OrangeSodahub

  committed
  ed7b088

  Copy full SHA for ed7b088

• fix: test ci

  OrangeSodahub

  committed
  7f04c42

  Copy full SHA for 7f04c42

• fix: test ci

  OrangeSodahub

  committed
  7e1fb91

  Copy full SHA for 7e1fb91

• fix: test ci

  OrangeSodahub

  committed
  51a4761

  Copy full SHA for 51a4761

• fix: test ci

  OrangeSodahub

  committed
  013270a

  Copy full SHA for 013270a

• fix: test ci

  OrangeSodahub

  committed
  280d713

  Copy full SHA for 280d713

Commits on Nov 14, 2022

• fix: passby flash attention

  OrangeSodahub

  committed
  ab52be2

  Copy full SHA for ab52be2

• fix: test ci

  OrangeSodahub

  committed
  979a42c

  Copy full SHA for 979a42c

• Revert "fix: test ci"

  Show description for 733d572
  OrangeSodahub

  committed
  733d572

  Copy full SHA for 733d572