BERT for dummies

rolyan_trauts · May 28, 2020, 8:24am

Bozor · May 28, 2020, 5:56pm

Awesome article. I’ve just finished building a neural network to teach BERT to solve questions from the SWAG dataset.

rolyan_trauts · May 28, 2020, 5:59pm

Your doing better than me @Bozor as it confuses the hell out of me, BERT for dummies is going to take some reading

Bozor · May 28, 2020, 6:02pm

Well. Have a look. It’s been a lab at uni so I haven’t done all myself. We are using a pretrained model of huggingface.

It’s all in german but I guess with some help of deepL you’ll get the idea

rolyan_trauts · May 28, 2020, 6:48pm

Yeah until that article I thought hugging face was them horrible things off alien.

Its a bit similar to how I feel about the CNN tensor flow network I was playing with that after a bit of playing I sort of got accustomed to the code but also slightly perturbed that I wouldn’t have a clue how to start from scratch.