answerdotai/ModernBERT-base

#66 opened 26 days ago by

devs9

LayerNorm.init() got an unexpected keyword argument 'bias'

#65 opened about 1 month ago by

clabluo

ModernBert vs Bert for text classification

#64 opened about 1 month ago by

Joseph2805

Question about MLDR Evaluation Metrics in ModernBERT Paper

#62 opened about 1 month ago by

WoutDeRijck

I have trained a multilingual version of ModernBert

#60 opened about 1 month ago by

neavo

nan or 0.0 loss when training with flash attention

16

#59 opened about 1 month ago by

roadtoagi

Modernbert with Golang

#58 opened about 1 month ago by

Thibault-Requesty

ModernBERT fails to work without FlashAttention !

#56 opened about 2 months ago by

benhachem

Import fails on AWS lamba instance.

#55 opened about 2 months ago by

obeijbom

Performance vs the original architecture on approximate original data sizes (BooksCorpus/Wikipedia)

#54 opened about 2 months ago by

tollefj

Problem with highly padded sequences

#49 opened 2 months ago by

fmrs

Speed Benchmarks with MPS Backend

#47 opened 2 months ago by

mlburnham

Continual pre-training for multilingual support (extend embedding matrix and tokenizer)

#46 opened 2 months ago by

ibotana

Encountering Error: cannot import name 'shard_checkpoint' from 'transformers.modeling_utils'

#44 opened 2 months ago by

rkabir

ModernBertModel works on the CPU but fails on the GPU

#43 opened 2 months ago by

rudigung

ModernBERT-base-chinese

#42 opened 2 months ago by

ZBW

Error: RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert because of the following error (look up to see its traceback): Windows not yet supported for torch.compile

5

#40 opened 2 months ago by

JoAmps42i

ModernBART wen?

6

#38 opened 2 months ago by

Fizzarolli

Pretraining Using HF Tokenizers and Transformers

#36 opened 2 months ago by

akhooli

Update README.md

#35 opened 2 months ago by

solankibhargav

Unpadding and Sequence Packing inference example?

#34 opened 2 months ago by

denti

Interview Request: Thoughts on Model Documentation

#33 opened 2 months ago by

evatang

Training Data?

#32 opened 3 months ago by

binarymax

What is the position of this model in MTEB leaderboard?

#31 opened 3 months ago by

deepak-banka

tokenizer

#24 opened 3 months ago by

ulasarikaya

RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert

#21 opened 3 months ago by

SantoshHF

Pretraining data cutoff?

#17 opened 3 months ago by

ytsaig

How to use ModernBERT with the AutoModelForQuestionAnswering class?

#15 opened 3 months ago by

sraj

Is ModernBERT already fine-tuned for IR tasks?

#13 opened 3 months ago by

belerico

Question about output embedding vector of ModernBERT

#12 opened 3 months ago by

Youm9602

ModernBert for multi-vector embeddings

#11 opened 3 months ago by

admarcosai

How to use ModernBERT as a sentence transformer?

30

#9 opened 3 months ago by

hungrybiker

multilingual

#8 opened 3 months ago by

ale-volpe

Is this model meant for full bfloat16, AMP bfloat16 or no bfloat16?

#7 opened 3 months ago by

umarbutler

# Fine-tuning ModernBERT on a Large Dataset with Masked Language Modelling

#6 opened 3 months ago by

ssmits

Precisions about the config properties wrt the paper