Teaching Transformers / Attention networks

JavaScript isn't enabled in your browser, so this file can't be opened. Enable and reload.

Just a form to gather some basic information from my audience, so I can strategize on either creating a curriculum, or offer group or private tutoring services

Email *

You are a *

student

industry - research

industry - applied research

Other:

You are interested in learning about attention and transformers because *

for school

for research

for startup / company

Other:

Would you prefer a course or private one-on-one tutoring? *

course

private tutoring

Other:

What is your preferred deep learning framework? *

tensorflow

pytorch

jax

Other:

What topics in transformers do you care most about? *

fundamentals

coding up transformers from scratch

training language models

the field of sub-quadratic efficient attention / transformers

being able to read and understand papers

Other:

Required

What do you think would be the most effective way to transfer my knowledge on this subject to you? (live-coding session, course, private tutoring)

What is your proficiency level with reading the latest papers in artificial intelligence? *

beginner

medium

expert

What is your proficiency level with coding in one of the deep learning frameworks? *

beginner

medium

expert

Are you well-versed in english? *

yes

Other:

Other interests

practical understanding and intuition behind attention, positional encoding, and other friends that make transformers work

the beginning of a mindmap of attention and transformers, or the skills to fill one out in the areas of interest, across different modalities, applications, architectures: how do variants relate and/or differ, what makes them work in specific domains, what routes could one take through such a mindmap for a domain specific application, etc.

the ability to read and interpret new approaches quickly from the literature, reading through the noise

how to code all this attention efficiently and cleanly, how to partition code one could find about a transformer model in the wild in its different parts, etc.

a few case studies on different domains

Other:

Where are you located? *

San Francisco

Bay Area

USA

Europe

Other:

Submit

Clear form

Never submit passwords through Google Forms.

This content is neither created nor endorsed by Google. Report Abuse - Terms of Service - Privacy Policy

Forms