• Home
  • About
  • Contact
  • Home
  • About
  • Contact


Why creativity is important for kids?

    Child-development experts are recognizing the importance of imagination and the role it plays in understanding reality.
    Imagination is necessary for learning about people and events we don't directly experience, such as history or events on the other side of the world.
    For young kids, it allows them to ponder the future, such as what they want to do when they grow up.

More info on Transformer Model

    Introduced in 2017 by a team at Google Brain and are increasingly the model of choice for NLP problems, replacing RNN models such as long short-term memory(LSTM)
    A transformer is a deep learning model that adopts the mechanism of self-attention.
    Attention mechanisms let a model draw from the state at any preceding point along the sequence.

Built with the powerful GPT-2

    Generative Pre-trained Transformer 2(GPT-2) is an open-source artificial intelligence created by OpenAI in February 2019.
    GPT's "semi-supervised" approach involved two stages: an unsupervised generative "pre-training" stage in which a language modeling objective was used to set initial parameters, and a supervised discriminative "fine-tuning" stage in which these parameters were adapted to a target task.
    The use of a transformer architecture, as opposed to previous techniques involving attention-augmented RNNs, provided GPT with a more structured memory than could be achieved through recurrent mechanisms; this resulted in "robust transfer performance across diverse tasks"

Our datasets

    🧚‍♀️ Fairytale data taken from various authors of the 19th and 20th century such as Grimm, Anderson, Andrew Lang, Arabian nights, and collections of fairy tales from Russian, China : 12.49MB, Unique word count : 42718
    👺 Lovecraft data collected from Kaggle, his entire collection of stories which is : 8MB of data, 102 stories, Unique word count 45543
    👾 Sci-fi data collected from Kaggle, the dataset taken from the Pulp Magazine archives : 149MB, Unique word Count : 330117

Michael Sullivan, Lucas Crouch, Clare Zhang, Benjamin Martin 
Copyright. 2022

Made with ❤️

@

Le Wagon Shanghai Batch 708