readme: ---
  language: en
  license: apache-2.0
  datasets:
  - cnn_dailymail
  tags:
  - summarization
  ---
  
  # Roberta2Roberta_L-24_cnn_daily_mail EncoderDecoder model
  
  The model was introduced in 
  [this paper](https://arxiv.org/abs/1907.12461) by Sascha Rothe, Shashi Narayan, Aliaksei Severyn and first released in [this repository](https://tfhub.dev/google/bertseq2seq/roberta24_cnndm/1). 
  
  The model is an encoder-decoder model that was initialized on the `roberta-large` checkpoints for both the encoder 
  and decoder and fine-tuned on summarization on the CNN / Dailymail dataset, which is linked above.
  
  Disclaimer: The model card has been written by the Hugging Face team.
  
  ## How to use
  
  You can use this model for summarization, *e.g.*
  
  ```python
  from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
  
  tokenizer = AutoTokenizer.from_pretrained("google/roberta2roberta_L-24_cnn_daily_mail")
  model = AutoModelForSeq2SeqLM.from_pretrained("google/roberta2roberta_L-24_cnn_daily_mail")
  
  article = """	(The Hollywood Reporter)"The Rocky Horror Picture
  Show" is the latest musical getting the small-
  screen treatment. Fox is developing a two-hour
  remake of the 1975 cult classic to be directed,
  executive-produced and choreographed by Kenneth
  Ortega ("High School Musical"). The project,
  tentatively titled "The Rocky Horror Picture Show
  Event," is casting-contingent. The special will be
  filmed in advance and not air live, but few
  details beyond that are known. In addition to
  Ortega, Gail Berman and Lou Adler, who produced
  the original film, are also attached as executive
  producers. The special will be produced by Fox 21
  Television Studios, and Berman's The Jackal Group.
  The special is timed to celebrate the 40th
  anniversary of the film, which has grossed more
  than $112 million and still plays in theaters
  across the country. TV premiere dates: The
  complete guide . This isn't the first stab at
  adapting "The Rocky Horror Picture Show." In 2002,
  Fox unveiled plans for an adaptation timed to the
  30th anniversary that never came to fruition. The
  faces of pilot season 2015 . Fox's "Glee" covered
  several of the show's most popular songs for a
  Season 2 episode and even released a special "The
  Rocky Horror Glee Show" EP. There is no plan yet
  for when the adaptation will air. Fox also has a
  live musical production of "Grease", starring
  Julianne Hough and Vanessa Hudgens, scheduled to
  air on Jan. 31, 2016. Broadcast TV scorecard .
  Following in the footsteps of "The Sound of Music"
  and "Peter Pan," NBC recently announced plans to
  air a live version of The Wiz later this year.
  Ortega's credits include "Gilmore Girls," "This Is
  It" and "Hocus Pocus." He is repped by Paradigm
  and Hanson, Jacobson. ©2015 The Hollywood
  Reporter. All rights reserved."""
  
  input_ids = tokenizer(article, return_tensors="pt").input_ids
  output_ids = model.generate(input_ids)[0]
  print(tokenizer.decode(output_ids, skip_special_tokens=True))
  # should output
  # Fox is developing a two-hour remake of the 1975 cult classic. The special will be directed, executive-produced and choreographed by Kenneth Ortega. 
  # The special is timed to celebrate the 40th anniversary of the film, which has grossed more than $112 million.
  
  ```
  