The 43-year-old, who won 10 caps in the back row for Wales between 1996 and 1998 and captained his country on one occasion, has signed a short-term deal with the Exiles.
Jones has agreed to assist head coach Lyn Jones until the end of October as London Welsh prepare for their assault on the Aviva Premiership.
Former Sale boss Jones is currently coaching Russia, who are due to take on Canada and the USA in November, but a more long-term association with London Welsh hasn’t been entirely ruled out.
The ex-Ebbw Vale favourite took the Russian reigns in February 2011 for an initial five-week period during the Nations Cup but that role was made permanent in December after Jones oversaw their World Cup debut Down Under.
Jones spent seven years at Sale after joining the club as forwards coach in 2004 and was linked with vacancies at the Dragons and Blues before Darren Edwards and Phil Davies were appointed to those roles.
London Welsh begin their Premiership campaign with a home tie against last season’s runners up Leicester Tigers on September 2.
The RFU Championship winners have also added Romanian prop Paulica Ion to their squad on a one-year loan deal from London Irish, with former Castres lock Kirill Kulemin also heading to the Kassam Stadium.
Jones will also be joined at his new club by another Sale stalwart after hooker Neil Briggs left Bourgoin to return to England.