Since he was of Finnish ancestry and spoke fluent Finnish, Ylitalo's first assignment in the Foreign Service was as a political attaché at the United States Embassy in Helsinki, where he served from 1946 to 1950. Later he became the assistant chief of the State Department's Security Division; in this post, he was in a position where the Defense Department asked him to evaluate The Pond's material, to which he responded that he "could describe it in only one word, 'crap.'" From 1954 to 1958, Ylitalo served as Consul General in the United States Consulate in Munich. He then served from 1959 to 1962 as the United States Consul General in Manila, Philippines, in which capacity he, on March 6, 1959, reported to the State Department concerning "Conditions Affecting Cultural Presentations in Cebu". He opened the American Consulate in Cebu City, during his tenure in Manila. He was Director the State Department Visa Office in Washington from 1962 to 1968. He was appointed Consul General of the U.S. Consulate in Tijuana, Mexico, in 1968, where he served one year before his ambassadorial promotion.
Ylitalo was appointed Ambassador to Paraguay by President Richard Nixon on July 22, 1969, and presented his letter of accreditation to Alfredo Stroessner on August 14 of that year. Within sixteen months of Ylitalo's assumption of the mission in Paraguay, a major point of contention in Paraguay – United States relations came to light when two pounds of heroin were seized at Miami International Airport, aboard a plane from Paraguay in December 1970. Narcotics came to dominate the remainder of Ylitalo's tenure as Ambassador, becoming a topic that was always discussed in his conversations with Paraguayan officials. In April 1971, the Bureau of Narcotics and Dangerous Drugs successfully infiltrated the smuggling operation and found that Auguste Ricord was controlling the operation, which had smuggled five thousand kilograms of heroin into the United States between 1965 and 1970. The Paraguayans detained Ricord, but, much to the dismay of the United States, refused to extradite him. With the Paraguayan refusal to extradite, the embassy responded by expressing "profound disappointment and concern with the decision of the court", noting that "the accused is one of the heads of the international heroin trafficking industry, who has brought misery and death to thousands of youths in the United States and around the World." President Nixon threatened, in January 1972, to cut off foreign aid to Paraguay if Ricord was not extradited, but Paraguay still did not relent. With the Paraguayan refusal to extradite Ricord, Ylitalo was coming under fire from the American press for being too close to Stroessner. When he noted that there was insufficient evidence to directly connect Stroessner and others in the regime to direct participation in drug trafficking, the attacks against him from the press increased in their severity. Unable to secure Ricord's extradition and increasingly becoming a target for media attacks, Ylitalo was recalled by President Nixon on September 11, 1972.
Life after the Ambassadorship
Following the termination of his mission in Paraguay, Ylitalo was appointed to the U.S. Consulate in Toronto, in 1973. He served there as Consul General until his retirement to Washington, D.C., in 1976. Ylitalo died of cancer on February 10, 1987, at Sibley Memorial Hospital in Washington, D.C.