Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+  "word_embedding_dimension": 384,
+  "pooling_mode_cls_token": false,
+  "pooling_mode_mean_tokens": true,
+  "pooling_mode_max_tokens": false,
+  "pooling_mode_mean_sqrt_len_tokens": false,
+  "pooling_mode_weightedmean_tokens": false,
+  "pooling_mode_lasttoken": false,
+  "include_prompt": true
+}

README.md

@@ -0,0 +1,547 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- generated_from_trainer
+- dataset_size:44286
+- loss:MultipleNegativesRankingLoss
+base_model: sentence-transformers/all-MiniLM-L6-v2
+widget:
+- source_sentence: Repetition pitch is caused by what phenomenon?
+  sentences:
+  - It is still possible for two sounds of indefinite pitch to clearly be higher or
+    lower than one another. For instance, a snare drum sounds higher pitched than
+    a bass drum though both have indefinite pitch, because its sound contains higher
+    frequencies. In other words, it is possible and often easy to roughly discern
+    the relative pitches of two sounds of indefinite pitch, but sounds of indefinite
+    pitch do not neatly correspond to any specific pitch. A special type of pitch
+    often occurs in free nature when sound reaches the ear of an observer directly
+    from the source, and also after reflecting off a sound-reflecting surface. This
+    phenomenon is called repetition pitch, because the addition of a true repetition
+    of the original sound to itself is the basic prerequisite.
+  - It is still possible for two sounds of indefinite pitch to clearly be higher or
+    lower than one another. For instance, a snare drum sounds higher pitched than
+    a bass drum though both have indefinite pitch, because its sound contains higher
+    frequencies. In other words, it is possible and often easy to roughly discern
+    the relative pitches of two sounds of indefinite pitch, but sounds of indefinite
+    pitch do not neatly correspond to any specific pitch. A special type of pitch
+    often occurs in free nature when sound reaches the ear of an observer directly
+    from the source, and also after reflecting off a sound-reflecting surface. This
+    phenomenon is called repetition pitch, because the addition of a true repetition
+    of the original sound to itself is the basic prerequisite.
+  - Several recent movies have been filmed in New Haven, including Mona Lisa Smile
+    (2003), with Julia Roberts, The Life Before Her Eyes (2007), with Uma Thurman,
+    and Indiana Jones and the Kingdom of the Crystal Skull (2008) directed by Steven
+    Spielberg and starring Harrison Ford, Cate Blanchett and Shia LaBeouf. The filming
+    of Crystal Skull involved an extensive chase sequence through the streets of New
+    Haven. Several downtown streets were closed to traffic and received a "makeover"
+    to look like streets of 1957, when the film is set. 500 locals were cast as extras
+    for the film. In Everybody's Fine (2009), Robert De Niro has a close encounter
+    in what is supposed to be the Denver train station; the scene was filmed in New
+    Haven's Union Station.
+- source_sentence: Of what discipline is ethology a branch?
+  sentences:
+  - This time they succeeded, and on 31 December 1600, the Queen granted a Royal Charter
+    to "George, Earl of Cumberland, and 215 Knights, Aldermen, and Burgesses" under
+    the name, Governor and Company of Merchants of London trading with the East Indies.
+    For a period of fifteen years the charter awarded the newly formed company a monopoly
+    on trade with all countries east of the Cape of Good Hope and west of the Straits
+    of Magellan. Sir James Lancaster commanded the first East India Company voyage
+    in 1601 and returned in 1603. and in March 1604 Sir Henry Middleton commanded
+    the second voyage. General William Keeling, a captain during the second voyage,
+    led the third voyage from 1607 to 1610.
+  - In philosophy, emotions are studied in sub-fields such as ethics, the philosophy
+    of art (for example, sensory–emotional values, and matters of taste and sentimentality),
+    and the philosophy of music (see also Music and emotion). In history, scholars
+    examine documents and other sources to interpret and analyze past activities;
+    speculation on the emotional state of the authors of historical documents is one
+    of the tools of interpretation. In literature and film-making, the expression
+    of emotion is the cornerstone of genres such as drama, melodrama, and romance.
+    In communication studies, scholars study the role that emotion plays in the dissemination
+    of ideas and messages. Emotion is also studied in non-human animals in ethology,
+    a branch of zoology which focuses on the scientific study of animal behavior.
+    Ethology is a combination of laboratory and field science, with strong ties to
+    ecology and evolution. Ethologists often study one type of behavior (for example,
+    aggression) in a number of unrelated animals.
+  - In philosophy, emotions are studied in sub-fields such as ethics, the philosophy
+    of art (for example, sensory–emotional values, and matters of taste and sentimentality),
+    and the philosophy of music (see also Music and emotion). In history, scholars
+    examine documents and other sources to interpret and analyze past activities;
+    speculation on the emotional state of the authors of historical documents is one
+    of the tools of interpretation. In literature and film-making, the expression
+    of emotion is the cornerstone of genres such as drama, melodrama, and romance.
+    In communication studies, scholars study the role that emotion plays in the dissemination
+    of ideas and messages. Emotion is also studied in non-human animals in ethology,
+    a branch of zoology which focuses on the scientific study of animal behavior.
+    Ethology is a combination of laboratory and field science, with strong ties to
+    ecology and evolution. Ethologists often study one type of behavior (for example,
+    aggression) in a number of unrelated animals.
+- source_sentence: Which humans does evolutionary anthropology concern itself with
+    the biological and cultural evolution of?
+  sentences:
+  - Bell began a series of public demonstrations and lectures to introduce the new
+    invention to the scientific community as well as the general public. A short time
+    later, his demonstration of an early telephone prototype at the 1876 Centennial
+    Exposition in Philadelphia brought the telephone to international attention. Influential
+    visitors to the exhibition included Emperor Pedro II of Brazil. Later Bell had
+    the opportunity to demonstrate the invention personally to Sir William Thomson
+    (later, Lord Kelvin), a renowned Scottish scientist, as well as to Queen Victoria,
+    who had requested a private audience at Osborne House, her Isle of Wight home.
+    She called the demonstration "most extraordinary". The enthusiasm surrounding
+    Bell's public displays laid the groundwork for universal acceptance of the revolutionary
+    device.
+  - Evolutionary anthropology is the interdisciplinary study of the evolution of human
+    physiology and human behaviour and the relation between hominins and non-hominin
+    primates. Evolutionary anthropology is based in natural science and social science,
+    combining the human development with socioeconomic factors. Evolutionary anthropology
+    is concerned with both biological and cultural evolution of humans, past and present.
+    It is based on a scientific approach, and brings together fields such as archaeology,
+    behavioral ecology, psychology, primatology, and genetics. It is a dynamic and
+    interdisciplinary field, drawing on many lines of evidence to understand the human
+    experience, past and present.
+  - Evolutionary anthropology is the interdisciplinary study of the evolution of human
+    physiology and human behaviour and the relation between hominins and non-hominin
+    primates. Evolutionary anthropology is based in natural science and social science,
+    combining the human development with socioeconomic factors. Evolutionary anthropology
+    is concerned with both biological and cultural evolution of humans, past and present.
+    It is based on a scientific approach, and brings together fields such as archaeology,
+    behavioral ecology, psychology, primatology, and genetics. It is a dynamic and
+    interdisciplinary field, drawing on many lines of evidence to understand the human
+    experience, past and present.
+- source_sentence: 'Where did florida rank in population growth '
+  sentences:
+  - The United States Census Bureau estimates that the population of Florida was 20,271,272
+    on July 1, 2015, a 7.82% increase since the 2010 United States Census. The population
+    of Florida in the 2010 census was 18,801,310. Florida was the seventh fastest-growing
+    state in the U.S. in the 12-month period ending July 1, 2012. In 2010, the center
+    of population of Florida was located between Fort Meade and Frostproof. The center
+    of population has moved less than 5 miles (8 km) to the east and approximately
+    1 mile (1.6 km) to the north between 1980 and 2010 and has been located in Polk
+    County since the 1960 census. The population exceeded 19.7 million by December
+    2014, surpassing the population of the state of New York for the first time.
+  - 'Treaties can be loosely compared to contracts: both are means of willing parties
+    assuming obligations among themselves, and a party to either that fails to live
+    up to their obligations can be held liable under international law.'
+  - The United States Census Bureau estimates that the population of Florida was 20,271,272
+    on July 1, 2015, a 7.82% increase since the 2010 United States Census. The population
+    of Florida in the 2010 census was 18,801,310. Florida was the seventh fastest-growing
+    state in the U.S. in the 12-month period ending July 1, 2012. In 2010, the center
+    of population of Florida was located between Fort Meade and Frostproof. The center
+    of population has moved less than 5 miles (8 km) to the east and approximately
+    1 mile (1.6 km) to the north between 1980 and 2010 and has been located in Polk
+    County since the 1960 census. The population exceeded 19.7 million by December
+    2014, surpassing the population of the state of New York for the first time.
+- source_sentence: What is the name of the cup that some Catholics think is the Grail?
+  sentences:
+  - On 20 September 2013, Queen + Adam Lambert performed at the iHeartRadio Music
+    Festival at the MGM Grand Hotel & Casino in Las Vegas. On 6 March 2014, the band
+    announced on Good Morning America that Queen + Adam Lambert will tour North America
+    in Summer 2014. The band will also tour Australia and New Zealand in August/September
+    2014. In an interview with Rolling Stone, May and Taylor said that although the
+    tour with Lambert is a limited thing, they are open to him becoming an official
+    member, and cutting new material with him.
+  - The quail is a small to medium-sized, cryptically coloured bird. In its natural
+    environment, it is found in bushy places, in rough grassland, among agricultural
+    crops, and in other places with dense cover. It feeds on seeds, insects, and other
+    small invertebrates. Being a largely ground-dwelling, gregarious bird, domestication
+    of the quail was not difficult, although many of its wild instincts are retained
+    in captivity. It was known to the Egyptians long before the arrival of chickens
+    and was depicted in hieroglyphs from 2575 BC. It migrated across Egypt in vast
+    flocks and the birds could sometimes be picked up off the ground by hand. These
+    were the common quail (Coturnix coturnix), but modern domesticated flocks are
+    mostly of Japanese quail (Coturnix japonica) which was probably domesticated as
+    early as the 11th century AD in Japan. They were originally kept as songbirds,
+    and they are thought to have been regularly used in song contests.
+  - On 9 July 2006, during Mass at Valencia's Cathedral, Our Lady of the Forsaken
+    Basilica, Pope Benedict XVI used, at the World Day of Families, the Santo Caliz,
+    a 1st-century Middle-Eastern artifact that some Catholics believe is the Holy
+    Grail. It was supposedly brought to that church by Emperor Valerian in the 3rd
+    century, after having been brought by St. Peter to Rome from Jerusalem. The Santo
+    Caliz (Holy Chalice) is a simple, small stone cup. Its base was added in Medieval
+    Times and consists of fine gold, alabaster and gem stones.
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+metrics:
+- cosine_accuracy
+model-index:
+- name: SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
+  results:
+  - task:
+      type: triplet
+      name: Triplet
+    dataset:
+      name: gooqa dev
+      type: gooqa-dev
+    metrics:
+    - type: cosine_accuracy
+      value: 0.40779998898506165
+      name: Cosine Accuracy
+---
+
+# SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision c9745ed1d9f207416be6d2e6f8de32d1f16199bf -->
+- **Maximum Sequence Length:** 256 tokens
+- **Output Dimensionality:** 384 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 
+  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("ayushexel/embed-all-MiniLM-L6-v2-squad-2-epochs")
+# Run inference
+sentences = [
+    'What is the name of the cup that some Catholics think is the Grail?',
+    "On 9 July 2006, during Mass at Valencia's Cathedral, Our Lady of the Forsaken Basilica, Pope Benedict XVI used, at the World Day of Families, the Santo Caliz, a 1st-century Middle-Eastern artifact that some Catholics believe is the Holy Grail. It was supposedly brought to that church by Emperor Valerian in the 3rd century, after having been brought by St. Peter to Rome from Jerusalem. The Santo Caliz (Holy Chalice) is a simple, small stone cup. Its base was added in Medieval Times and consists of fine gold, alabaster and gem stones.",
+    'The quail is a small to medium-sized, cryptically coloured bird. In its natural environment, it is found in bushy places, in rough grassland, among agricultural crops, and in other places with dense cover. It feeds on seeds, insects, and other small invertebrates. Being a largely ground-dwelling, gregarious bird, domestication of the quail was not difficult, although many of its wild instincts are retained in captivity. It was known to the Egyptians long before the arrival of chickens and was depicted in hieroglyphs from 2575 BC. It migrated across Egypt in vast flocks and the birds could sometimes be picked up off the ground by hand. These were the common quail (Coturnix coturnix), but modern domesticated flocks are mostly of Japanese quail (Coturnix japonica) which was probably domesticated as early as the 11th century AD in Japan. They were originally kept as songbirds, and they are thought to have been regularly used in song contests.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 384]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities.shape)
+# [3, 3]
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+## Evaluation
+
+### Metrics
+
+#### Triplet
+
+* Dataset: `gooqa-dev`
+* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
+
+| Metric              | Value      |
+|:--------------------|:-----------|
+| **cosine_accuracy** | **0.4078** |
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 44,286 training samples
+* Columns: <code>question</code>, <code>context</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | question                                                                          | context                                                                              | negative                                                                             |
+  |:--------|:----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                            | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 6 tokens</li><li>mean: 14.48 tokens</li><li>max: 39 tokens</li></ul> | <ul><li>min: 28 tokens</li><li>mean: 147.46 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>min: 29 tokens</li><li>mean: 147.85 tokens</li><li>max: 256 tokens</li></ul> |
+* Samples:
+  | question                                                     | context                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
+  |:-------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>What are the two cycles of the Greek folk song?</code> | <code>Along with the Byzantine (Church) chant and music, the Greek people also cultivated the Greek folk song which is divided into two cycles, the akritic and klephtic. The akritic was created between the 9th and 10th centuries and expressed the life and struggles of the akrites (frontier guards) of the Byzantine empire, the most well known being the stories associated with Digenes Akritas. The klephtic cycle came into being between the late Byzantine period and the start of the Greek War of Independence. The klephtic cycle, together with historical songs, paraloghes (narrative song or ballad), love songs, mantinades, wedding songs, songs of exile and dirges express the life of the Greeks. There is a unity between the Greek people's struggles for freedom, their joys and sorrow and attitudes towards love and death.</code>                                                                                                                                                                                        | <code>The Hellenic languages or Greek language are widely spoken in Greece and in the Greek part of Cyprus. Additionally, other varieties of Greek are spoken in small communities in parts of other European counties.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
+  | <code>What material is within a wrestling ring?</code>       | <code>Matches are held within a wrestling ring, an elevated square canvas mat with posts on each corner. A cloth apron hangs over the edges of the ring. Three horizontal ropes or cables surround the ring, suspended with turnbuckles which are connected to the posts. For safety, the ropes are padded at the turnbuckles and cushioned mats surround the floor outside the ring. Guardrails or a similar barrier enclose this area from the audience. Wrestlers are generally expected to stay within the confines of the ring, though matches sometimes end up outside the ring, and even in the audience, to add excitement.</code>                                                                                                                                                                                                                                                                                                                                                                                                               | <code>Many modern specialty matches have been devised, with unique winning conditions. The most common of these is the ladder match. In the basic ladder match, the wrestlers or teams of wrestlers must climb a ladder to obtain a prize that is hoisted above the ring. The key to winning this match is that the wrestler or team of wrestlers must try to incapacitate each other long enough for one wrestler to climb the ladder and secure that prize for their team. As a result, the ladder can be used as a weapon. The prizes include – but are not limited to any given championship belt (the traditional prize), a document granting the winner the right to a future title shot, or any document that matters to the wrestlers involved in the match (such as one granting the winner a cash prize). Another common specialty match is known as the battle royal. In a battle royal, all the wrestlers enter the ring to the point that there are 20-30 wrestlers in the ring at one time. When the match begins, the simple ob...</code> |
+  | <code>What is the Hebrew Bible?</code>                       | <code>The Hebrew Bible, a religious interpretation of the traditions and early national history of the Jews, established the first of the Abrahamic religions, which are now practiced by 54% of the world. Judaism guides its adherents in both practice and belief, and has been called not only a religion, but also a "way of life," which has made drawing a clear distinction between Judaism, Jewish culture, and Jewish identity rather difficult. Throughout history, in eras and places as diverse as the ancient Hellenic world, in Europe before and after The Age of Enlightenment (see Haskalah), in Islamic Spain and Portugal, in North Africa and the Middle East, India, China, or the contemporary United States and Israel, cultural phenomena have developed that are in some sense characteristically Jewish without being at all specifically religious. Some factors in this come from within Judaism, others from the interaction of Jews or specific communities of Jews with their surroundings, others from the in...</code> | <code>Israel's diverse culture stems from the diversity of its population: Jews from diaspora communities around the world have brought their cultural and religious traditions back with them, creating a melting pot of Jewish customs and beliefs. Israel is the only country in the world where life revolves around the Hebrew calendar. Work and school holidays are determined by the Jewish holidays, and the official day of rest is Saturday, the Jewish Sabbath. Israel's substantial Arab minority has also left its imprint on Israeli culture in such spheres as architecture, music, and cuisine.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                  |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim"
+  }
+  ```
+
+### Evaluation Dataset
+
+#### Unnamed Dataset
+
+* Size: 5,000 evaluation samples
+* Columns: <code>question</code>, <code>context</code>, and <code>negative_1</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | question                                                                          | context                                                                              | negative_1                                                                           |
+  |:--------|:----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                            | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 6 tokens</li><li>mean: 14.47 tokens</li><li>max: 36 tokens</li></ul> | <ul><li>min: 28 tokens</li><li>mean: 147.36 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>min: 28 tokens</li><li>mean: 146.82 tokens</li><li>max: 256 tokens</li></ul> |
+* Samples:
+  | question                                                                       | context                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | negative_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
+  |:-------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>What state supported DST because it wanted to sell more potatoes?</code> | <code>The history of time in the United States includes DST during both world wars, but no standardization of peacetime DST until 1966. In May 1965, for two weeks, St. Paul, Minnesota and Minneapolis, Minnesota were on different times, when the capital city decided to join most of the nation by starting Daylight Saving Time while Minneapolis opted to follow the later date set by state law. In the mid-1980s, Clorox (parent of Kingsford Charcoal) and 7-Eleven provided the primary funding for the Daylight Saving Time Coalition behind the 1987 extension to US DST, and both Idaho senators voted for it based on the premise that during DST fast-food restaurants sell more French fries, which are made from Idaho potatoes.</code>                                                                                                                                                                                                                                                                                                | <code>The history of time in the United States includes DST during both world wars, but no standardization of peacetime DST until 1966. In May 1965, for two weeks, St. Paul, Minnesota and Minneapolis, Minnesota were on different times, when the capital city decided to join most of the nation by starting Daylight Saving Time while Minneapolis opted to follow the later date set by state law. In the mid-1980s, Clorox (parent of Kingsford Charcoal) and 7-Eleven provided the primary funding for the Daylight Saving Time Coalition behind the 1987 extension to US DST, and both Idaho senators voted for it based on the premise that during DST fast-food restaurants sell more French fries, which are made from Idaho potatoes.</code>                                                                                                                                                                                                                                                                                                |
+  | <code>Who dealt with the design faults of the palace?</code>                   | <code>Buckingham Palace finally became the principal royal residence in 1837, on the accession of Queen Victoria, who was the first monarch to reside there; her predecessor William IV had died before its completion. While the state rooms were a riot of gilt and colour, the necessities of the new palace were somewhat less luxurious. For one thing, it was reported the chimneys smoked so much that the fires had to be allowed to die down, and consequently the court shivered in icy magnificence. Ventilation was so bad that the interior smelled, and when a decision was taken to install gas lamps, there was a serious worry about the build-up of gas on the lower floors. It was also said that staff were lax and lazy and the palace was dirty. Following the queen's marriage in 1840, her husband, Prince Albert, concerned himself with a reorganisation of the household offices and staff, and with the design faults of the palace. The problems were all rectified by the close of 1840. However, the builders w...</code> | <code>Buckingham Palace finally became the principal royal residence in 1837, on the accession of Queen Victoria, who was the first monarch to reside there; her predecessor William IV had died before its completion. While the state rooms were a riot of gilt and colour, the necessities of the new palace were somewhat less luxurious. For one thing, it was reported the chimneys smoked so much that the fires had to be allowed to die down, and consequently the court shivered in icy magnificence. Ventilation was so bad that the interior smelled, and when a decision was taken to install gas lamps, there was a serious worry about the build-up of gas on the lower floors. It was also said that staff were lax and lazy and the palace was dirty. Following the queen's marriage in 1840, her husband, Prince Albert, concerned himself with a reorganisation of the household offices and staff, and with the design faults of the palace. The problems were all rectified by the close of 1840. However, the builders w...</code> |
+  | <code>On what date did IndyMac fail?</code>                                    | <code>The first visible institution to run into trouble in the United States was the Southern California–based IndyMac, a spin-off of Countrywide Financial. Before its failure, IndyMac Bank was the largest savings and loan association in the Los Angeles market and the seventh largest mortgage originator in the United States. The failure of IndyMac Bank on July 11, 2008, was the fourth largest bank failure in United States history up until the crisis precipitated even larger failures, and the second largest failure of a regulated thrift. IndyMac Bank's parent corporation was IndyMac Bancorp until the FDIC seized IndyMac Bank. IndyMac Bancorp filed for Chapter 7 bankruptcy in July 2008.</code>                                                                                                                                                                                                                                                                                                                             | <code>The first visible institution to run into trouble in the United States was the Southern California–based IndyMac, a spin-off of Countrywide Financial. Before its failure, IndyMac Bank was the largest savings and loan association in the Los Angeles market and the seventh largest mortgage originator in the United States. The failure of IndyMac Bank on July 11, 2008, was the fourth largest bank failure in United States history up until the crisis precipitated even larger failures, and the second largest failure of a regulated thrift. IndyMac Bank's parent corporation was IndyMac Bancorp until the FDIC seized IndyMac Bank. IndyMac Bancorp filed for Chapter 7 bankruptcy in July 2008.</code>                                                                                                                                                                                                                                                                                                                             |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim"
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: steps
+- `per_device_train_batch_size`: 128
+- `per_device_eval_batch_size`: 128
+- `num_train_epochs`: 2
+- `warmup_ratio`: 0.1
+- `fp16`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: steps
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 128
+- `per_device_eval_batch_size`: 128
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 5e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 2
+- `max_steps`: -1
+- `lr_scheduler_type`: linear
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: False
+- `fp16`: True
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: False
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `tp_size`: 0
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `dispatch_batches`: None
+- `split_batches`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+
+</details>
+
+### Training Logs
+| Epoch  | Step | Training Loss | Validation Loss | gooqa-dev_cosine_accuracy |
+|:------:|:----:|:-------------:|:---------------:|:-------------------------:|
+| -1     | -1   | -             | -               | 0.3266                    |
+| 0.2890 | 100  | 0.4285        | 0.7828          | 0.3894                    |
+| 0.5780 | 200  | 0.3895        | 0.7691          | 0.4006                    |
+| 0.8671 | 300  | 0.3744        | 0.7545          | 0.3992                    |
+| 1.1561 | 400  | 0.3157        | 0.7396          | 0.4070                    |
+| 1.4451 | 500  | 0.2715        | 0.7422          | 0.4074                    |
+| 1.7341 | 600  | 0.2672        | 0.7405          | 0.4080                    |
+| -1     | -1   | -             | -               | 0.4078                    |
+
+
+### Framework Versions
+- Python: 3.11.0
+- Sentence Transformers: 4.0.1
+- Transformers: 4.50.3
+- PyTorch: 2.6.0+cu124
+- Accelerate: 1.5.2
+- Datasets: 3.5.0
+- Tokenizers: 0.21.1
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,25 @@
+{
+  "architectures": [
+    "BertModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 384,
+  "initializer_range": 0.02,
+  "intermediate_size": 1536,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 6,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.50.3",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 30522
+}

config_sentence_transformers.json

@@ -0,0 +1,10 @@
+{
+  "__version__": {
+    "sentence_transformers": "4.0.1",
+    "transformers": "4.50.3",
+    "pytorch": "2.6.0+cu124"
+  },
+  "prompts": {},
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18d7314cf336de88475ee3cc21e5a9bcda25098fcfb4def584d504ea8ddd2dd1
+size 90864192

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+  "max_seq_length": 256,
+  "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,65 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": true,
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "max_length": 128,
+  "model_max_length": 256,
+  "never_split": null,
+  "pad_to_multiple_of": null,
+  "pad_token": "[PAD]",
+  "pad_token_type_id": 0,
+  "padding_side": "right",
+  "sep_token": "[SEP]",
+  "stride": 0,
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
+  "unk_token": "[UNK]"
+}