Issue with Rope Scaling
1
#31 opened 21 days ago
by
ritwickchaudhryamazon
AssertionError: Flash Attention is not available, but is needed for dense attention
2
#30 opened 22 days ago
by
tpadhi1
Fast Tokenization for Phi3-small
#29 opened 27 days ago
by
mfajcik
update positional_embedding.py
#28 opened 28 days ago
by
mwirth-epo
"OutOfResources: out of resource: shared memory, Required: 180224, Hardware limit: 101376. "
1
#27 opened 30 days ago
by
joker26
Slower generation with multi-batch size.
#26 opened about 1 month ago
by
Satandon1999
why only small model use MuP ?
#24 opened about 1 month ago
by
xdseunghyun
tokenizer gives unexpected results
#23 opened about 2 months ago
by
jpiabrantes
Does it support system?
#22 opened about 2 months ago
by
lucasjin
Upload triton_flash_blocksparse_attn.py
#21 opened about 2 months ago
by
barcelosallan
"TypeError: phi3 isn't supported yet ". Could not quantize the phi3 model using the AWQ quantization method.
3
#20 opened about 2 months ago
by
rabinghimire737
Multi-GPU case device mismatch while finetuning.
3
#19 opened 2 months ago
by
Satandon1999
CheckpointError in `triton_flash_blocksparse_attn.py` while finetuning
1
#18 opened 2 months ago
by
FremyCompany
Fix for FlashAttention RuntimeError & Triton Multi GPU fix.
1
#17 opened 2 months ago
by
Satandon1999
Out of resource: shared memory
3
#16 opened 2 months ago
by
iszhaoxin
RuntimeError: FlashAttention only support fp16 and bf16 data type
1
#15 opened 2 months ago
by
Satandon1999
Adding sample_finetune.py to small model
1
#9 opened 3 months ago
by
hackint0sh
The attention mask and the pad token id were not set
#8 opened 3 months ago
by
hamidpalangi