Repeat Tokens
Has anyone faced the issue of the model generating repeated tokens,. (repeat to the end, even in the first turn). Here is the query from browser-comp benchmark.
[Q15: An individual with a popular nickname grew up in a Buddhist temple and came to New York in the 1980s. Between 2001 and 2011 (inclusive), ten years after this individual established a neighborhood watch program, they published their second book. Between 2011 and 2020 (inclusive) they wrote a piece for a newspaper founded between 1870 and 1880 (exclusive). Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s. Give me the first individual’s nickname.
A15: [{'role': 'user', 'content': 'An individual with a popular nickname grew up in a Buddhist temple and came to New York in the 1980s. Between 2001 and 2011 (inclusive), ten years after this individual established a neighborhood watch program, they published their sec
ond book. Between 2011 and 2020 (inclusive) they wrote a piece for a newspaper founded between 1870 and 1880 (exclusive). Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s. Give me the first ind
ividual’s nickname. '}, {'role': 'assistant', 'content': '\nWe have a puzzle: an individual with a popular nickname grew up in a Buddhist temple and came to New York in the 1980s. Between 2001 and 2011 inclusive, ten years after this individual established a neig
hborhood watch program, they published their second book. Between 2011 and 2020 inclusive they wrote a piece for a newspaper founded between 1870 and 1880 exclusive. Their full name is identical to the pen name of an author whose novel was serialized in the same newspap
er in the late 1930s. Give the first individual's nickname.\n\nWe need to identify the individual with the nickname. The puzzle includes multiple clues.\n\nClue breakdown:\n\n- Individual has a popular nickname.\n- Grew up in a Buddhist temple.\n- Came to New York in t
he 1980s.\n- Established a neighborhood watch program (presumably a program like "Neighborhood Watch" or something specific).\n- Ten years later (i.e., 10 years after establishing the neighborhood watch program), between 2001 and 2011 inclusive, they published their sec
ond book.\n- So the second book publication date is between 2001 and 2011.\n- The neighborhood watch program was established 10 years before that, i.e., between 1991 and 2001 inclusive.\n- They also wrote a piece for a newspaper between 2011 and 2020 inclusive.\n- The n
ewspaper was founded between 1870 and 1880 exclusive, i.e., founded after 1870 and before 1880, so founded in 1871-1879 inclusive.\n- Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s (i.e., betw
een 1935-1939 maybe).\n- So we need to find a newspaper founded between 1871-1879, which serialized a novel in the late 1930s by an author who used a pen name identical to the individual's full name.\n- The individual's nickname is popular.\n\nThus we need to find a p
erson who grew up in a Buddhist temple, came to New York in the 1980s, started a neighborhood watch program around early 1990s, published a second book around early 2000s, wrote a piece for a newspaper founded in 1870s between 2011-2020, and shares a name with a pen nam
e of an author who serialized a novel in that newspaper in the late 1930s.\n\nWe need to find the nickname.\n\nFirst, think of Buddhist temple upbringing: People like "Krispy" no. Maybe a martial arts master? Or a chef? Or a writer? Could be a Buddhist monk turned write
r? Or someone known for being a "Buddhist temple kid".\n\nLet's think of notable people who grew up in a Buddhist temple: There is "Miyamoto Musashi"? No. There's "Miyazaki"? No. There is a famous figure "Mick Jagger"? No. Could be a musician.\n\nAlso, "came to New Yo
rk in the 1980s": Many immigrants came to New York in 80s. Could be a Chinese immigrant, Japanese, Korean, Vietnamese, etc.\n\nPopular nickname: Could be "The Buddha"? No.\n\nLet's think of someone who started a neighborhood watch program. Could be a community activist
.\n\nSecond book published between 2001-2011: So they have at least two books. Their second book published in that period. The first book likely earlier. Could be a memoir.\n\nThey wrote a piece for a newspaper between 2011-2020. The newspaper founded between 1870-1880.
Which newspapers were founded in that period? Let's list some major US newspapers founded in that period:\n\n- The New York Times was founded 1851 (not in range).\n- The Washington Post founded 1877. Yes, Washington Post was founded 1877. So that fits: founded between
1870 and 1880 exclusive (i.e., after 1870 and before 1880). So Washington Post is a candidate.\n\n- The Chicago Tribune was founded 1847 (not).\n- Los Angeles Times founded 1881 (just after 1880, not inclusive).\n- The Boston Globe founded 1872. Yes, Boston Globe found
ed 1872. So Boston Globe is also candidate.\n\n- The San Francisco Chronicle founded 1865 (not).\n- The New York Sun? 1833 (not).\n- The Denver Post founded 1892 (not).\n- The Philadelphia Inquirer founded 1829 (not).\n- The New York Daily News founded 1919 (not).\n- Th
e New York Herald Tribune 1841 (not).\n- The Seattle Times founded 1900 (not).\n- The Baltimore Sun founded 1837 (not).\n- The St. Louis Post-Dispatch founded 1878. Yes, St. Louis Post-Dispatch founded 1878.\n\n- The New York World? 1860.\n\n- The New York Journal? 1896
.\n\n- The Chicago Sun-Times? 1948.\n\n- The Miami Herald? 1903.\n\n- The New York Observer? 1987.\n\n- The New York Review of Books? 1963.\n\n- The New York Magazine? 1968.\n\n- The New York Times Magazine? 1857.\n\n- The New York Daily News? 1919.\n\n- The New York Po
st? 1801.\n\n- The New York Herald? 1835.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post?...](Q15: An individual with a popular nickname grew up in a Buddhist temple and came to New York in the 1980s. Between 2001 and 2011 (inclusive), ten years after this individual established a neighborhood watch program, they published their second book. Between 2011 and 2020 (inclusive) they wrote a piece for a newspaper founded between 1870 and 1880 (exclusive). Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s. Give me the first individual’s nickname.
A15: [{'role': 'user', 'content': 'An individual with a popular nickname grew up in a Buddhist temple and came to New York in the 1980s. Between 2001 and 2011 (inclusive), ten years after this individual established a neighborhood watch program, they published their second book. Between 2011 and 2020 (inclusive) they wrote a piece for a newspaper founded between 1870 and 1880 (exclusive). Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s. Give me the first individual’s nickname. '}, {'role': 'assistant', 'content': '\nWe have a puzzle: an individual with a popular nickname grew up in a Buddhist temple and came to New York in the 1980s. Between 2001 and 2011 inclusive, ten years after this individual established a neighborhood watch program, they published their second book. Between 2011 and 2020 inclusive they wrote a piece for a newspaper founded between 1870 and 1880 exclusive. Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s. Give the first individual's nickname.\n\nWe need to identify the individual with the nickname. The puzzle includes multiple clues.\n\nClue breakdown:\n\n- Individual has a popular nickname.\n- Grew up in a Buddhist temple.\n- Came to New York in the 1980s.\n- Established a neighborhood watch program (presumably a program like "Neighborhood Watch" or something specific).\n- Ten years later (i.e., 10 years after establishing the neighborhood watch program), between 2001 and 2011 inclusive, they published their second book.\n- So the second book publication date is between 2001 and 2011.\n- The neighborhood watch program was established 10 years before that, i.e., between 1991 and 2001 inclusive.\n- They also wrote a piece for a newspaper between 2011 and 2020 inclusive.\n- The newspaper was founded between 1870 and 1880 exclusive, i.e., founded after 1870 and before 1880, so founded in 1871-1879 inclusive.\n- Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s (i.e., between 1935-1939 maybe).\n- So we need to find a newspaper founded between 1871-1879, which serialized a novel in the late 1930s by an author who used a pen name identical to the individual's full name.\n- The individual's nickname is popular.\n\nThus we need to find a person who grew up in a Buddhist temple, came to New York in the 1980s, started a neighborhood watch program around early 1990s, published a second book around early 2000s, wrote a piece for a newspaper founded in 1870s between 2011-2020, and shares a name with a pen name of an author who serialized a novel in that newspaper in the late 1930s.\n\nWe need to find the nickname.\n\nFirst, think of Buddhist temple upbringing: People like "Krispy" no. Maybe a martial arts master? Or a chef? Or a writer? Could be a Buddhist monk turned writer? Or someone known for being a "Buddhist temple kid".\n\nLet's think of notable people who grew up in a Buddhist temple: There is "Miyamoto Musashi"? No. There's "Miyazaki"? No. There is a famous figure "Mick Jagger"? No. Could be a musician.\n\nAlso, "came to New York in the 1980s": Many immigrants came to New York in 80s. Could be a Chinese immigrant, Japanese, Korean, Vietnamese, etc.\n\nPopular nickname: Could be "The Buddha"? No.\n\nLet's think of someone who started a neighborhood watch program. Could be a community activist.\n\nSecond book published between 2001-2011: So they have at least two books. Their second book published in that period. The first book likely earlier. Could be a memoir.\n\nThey wrote a piece for a newspaper between 2011-2020. The newspaper founded between 1870-1880. Which newspapers were founded in that period? Let's list some major US newspapers founded in that period:\n\n- The New York Times was founded 1851 (not in range).\n- The Washington Post founded 1877. Yes, Washington Post was founded 1877. So that fits: founded between 1870 and 1880 exclusive (i.e., after 1870 and before 1880). So Washington Post is a candidate.\n\n- The Chicago Tribune was founded 1847 (not).\n- Los Angeles Times founded 1881 (just after 1880, not inclusive).\n- The Boston Globe founded 1872. Yes, Boston Globe founded 1872. So Boston Globe is also candidate.\n\n- The San Francisco Chronicle founded 1865 (not).\n- The New York Sun? 1833 (not).\n- The Denver Post founded 1892 (not).\n- The Philadelphia Inquirer founded 1829 (not).\n- The New York Daily News founded 1919 (not).\n- The New York Herald Tribune 1841 (not).\n- The Seattle Times founded 1900 (not).\n- The Baltimore Sun founded 1837 (not).\n- The St. Louis Post-Dispatch founded 1878. Yes, St. Louis Post-Dispatch founded 1878.\n\n- The New York World? 1860.\n\n- The New York Journal? 1896.\n\n- The Chicago Sun-Times? 1948.\n\n- The Miami Herald? 1903.\n\n- The New York Observer? 1987.\n\n- The New York Review of Books? 1963.\n\n- The New York Magazine? 1968.\n\n- The New York Times Magazine? 1857.\n\n- The New York Daily News? 1919.\n\n- The New York Post? 1801.\n\n- The New York Herald? 1835.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York Herald? 1835.\n\n- The New York Post? 1801.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n-e New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.11:19:11 [21/1837]
Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n-
The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The Ne
w York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 186
0.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New
York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times
? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The N
ew York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York
Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n
- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York E
vening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851
.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New Yor
k Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post?
1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The
New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening
Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n-
The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Trib
une? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.
\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New Yo
rk Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post?
1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The N
ew York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1
841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n-
The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun
? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.
\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New Yor
k World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n
\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The Ne
w York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833
.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n-
The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York Worl
d? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- Th
e New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York
Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n-
The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The Ne
w York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 186
0.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New
York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times
? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The N
ew York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York
Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n - The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York E
vening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851
.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New Yor
k Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post?
1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The
New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening
Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n-
The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Trib
une? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York Tribune? 1841.\n\n- The New York Evening Post? 1801.\n\n- The New York Post? 1801.
\n\n- The New York Times? 1851.\n\n- The New York World? 1860.\n\n- The New York Sun? 1833.\n\n- The New York).(repeat to the end, even in the first turn)
I'm using the vllm server
vllm serve Alibaba-NLP/Tongyi-DeepResearch-30B-A3B --host 0.0.0.0 --port 1234 --served-model-name Tongyi-DeepResearch-30B-A3B --tensor-parallel-size 4 --enable-expert-parallel --enable-auto-tool-choice --tool-call-parser hermes --max-model-len 128000 --trust-remote-code
Here is the code to reproduce the issue:
import numpy as np
import pandas as pd
import asyncio
import argparse
import hashlib
import json
import logging
import os
import subprocess
import sys
import tempfile
import urllib.parse
from datetime import datetime
from pathlib import Path
from typing import Any, Dict, List, Optional, Tuple
import httpx
import numpy as np
import pandas as pd
import requests
from dotenv import load_dotenv
from openai import AsyncOpenAI
from tqdm.asyncio import tqdm
# Import compression function
# from compress import comppress as compress
from fastmcp import FastMCP
mcp = FastMCP("Demo 🚀")
load_dotenv()
# Timeout constants (in seconds)
SEARCH_TIMEOUT = 512.0
VISIT_TIMEOUT = 256.0
CODE_EXECUTION_TIMEOUT = 256
# Search configuration
DEFAULT_SEARCH_TOP_K = 10
# Configure logging
logging.basicConfig(
level=logging.INFO,
format='%(asctime)s - %(levelname)s - %(message)s'
)
logger = logging.getLogger(__name__)
semaphore=None
async def process_question(question, openai_client, result_dir, index):
openai_tools = [
{"type": "function", "function": {"name": "search", "description": "Perform Google web searches then returns a string of the top search results. Accepts multiple queries.", "parameters": {"type": "object", "properties": {"query": {"type": "array", "items": {"type": "string", "description": "The search query."}, "minItems": 1, "description": "The list of search queries."}}, "required": ["query"]}}},
{"type": "function", "function": {"name": "visit", "description": "Visit webpage(s) and return the summary of the content.", "parameters": {"type": "object", "properties": {"url": {"type": "array", "items": {"type": "string"}, "description": "The URL(s) of the webpage(s) to visit. Can be a single URL or an array of URLs."}, "goal": {"type": "string", "description": "The specific information goal for visiting webpage(s)."}}, "required": ["url", "goal"]}}},
{"type": "function", "function": {"name": "PythonInterpreter", "description": """Executes Python code in a sandboxed environment. To use this tool, you must follow this format:
1. The 'arguments' JSON object must be empty: {}.
2. The Python code to be executed must be placed immediately after the JSON block, enclosed within <code> and </code> tags.
IMPORTANT: Any output you want to see MUST be printed to standard output using the print() function.
Example of a correct call:
<tool_call>
{"name": "PythonInterpreter", "arguments": {}}
<code>
import numpy as np
# Your code here
print(f"The result is: {np.mean([1,2,3])}")
</code>
</tool_call>""", "parameters": {"type": "object", "properties": {}, "required": []}}},
{"type": "function", "function": {"name": "google_scholar", "description": "Leverage Google Scholar to retrieve relevant information from academic publications. Accepts multiple queries. This tool will also return results from google search", "parameters": {"type": "object", "properties": {"query": {"type": "array", "items": {"type": "string", "description": "The search query."}, "minItems": 1, "description": "The list of search queries for Google Scholar."}}, "required": ["query"]}}},
{"type": "function", "function": {"name": "parse_file", "description": "This is a tool that can be used to parse multiple user uploaded local files such as PDF, DOCX, PPTX, TXT, CSV, XLSX, DOC, ZIP, MP4, MP3.", "parameters": {"type": "object", "properties": {"files": {"type": "array", "items": {"type": "string"}, "description": "The file name of the user uploaded local files to be parsed."}}, "required": ["files"]}}}
]
final_response = ""
web_search_dict = {}
messages = [
{"role": "user", "content": question},
]
max_steps=1
for step in range(max_steps):
completion = await openai_client.chat.completions.create(
model='Tongyi-DeepResearch-30B-A3B',
messages=messages,
tools=openai_tools,
max_tokens=8192,
temperature=0.6,
top_p=0.9
)
if step == 0:
print(messages, openai_tools, completion)
response = completion.choices[0].message
assistant_msg = {
"role": "assistant",
"content": response.content
}
if hasattr(response, "reasoning_content"):
assistant_msg['reasoning_content'] = response.reasoning_content
if response.tool_calls:
assistant_msg["tool_calls"] = [
{
"id": call.id,
"type": "function",
"function": {
"name": call.function.name,
"arguments": call.function.arguments
}
} for call in response.tool_calls
]
messages.append(assistant_msg)
output_path = os.path.join(result_dir, f"q{index}.json")
with open(output_path, "w", encoding="utf-8") as f:
json.dump(messages, f, ensure_ascii=False, indent=2)
return messages
async def process_question_with_limit(question, openai_client, result_dir, index):
async with semaphore: # Limits concurrent coroutines to 16
return await process_question(question, openai_client, result_dir, index)
async def main():
openai_client = AsyncOpenAI(
api_key='empty',
base_url="http://localhost:1234/v1"
)
question_repeat = "An individual with a popular nickname grew up in a Buddhist temple and came to New York in the 1980s. Between 2001 and 2011 (inclusive), ten years after this individual established a neighborhood watch program, they published their second book. Between 2011 and 2020 (inclusive) they wrote a piece for a newspaper founded between 1870 and 1880 (exclusive). Their full name is identical to the pen name of an author whose novel was serialized in the same newspaper in the late 1930s. Give me the first individual’s nickname. "
questions = [
question_repeat for _ in range(16)
]
MAX_CONCURRENCY = 16
global semaphore
semaphore = asyncio.Semaphore(MAX_CONCURRENCY)
RESULTS_DIR = "results_cc4"
# run async here
tasks = [process_question_with_limit(q, openai_client, RESULTS_DIR, index) for index, q in enumerate(questions)]
results = await asyncio.gather(*tasks)
# Print or save results
for i, (q, r) in enumerate(zip(questions, results), 1):
print(f"\nQ{i}: {q}\nA{i}: {r}\n{'-'*80}")
if __name__ == '__main__':
asyncio.run(main())
```
I think all large language models may fall into the problem of repeating output (just like all models may hallucinate), it's just a matter of probability. I have personally seen DeepSeek-R1 fall into repeating outputs as well.
I have been using this model regularly since it's release, and I haven't had that issue with my deployment. I am using a "Custom LLM" Deployment with a H200-141GB GPU at DeepInfra. So it is running on DeepInfra's server, and they pull the model directly from Huggingface. So I wouldn't say it is something inherent in the model, but perhaps something with your vLLM deployment.
@jebbam thanks, I agreed with @cloudydory , maybe for the hard/long problem it sometimes repeating output like other model such as deepseek-r1....