When I embed a JPG image Inkscape does not respect the Orientation tag in the EXIF data. This has not been a problem previously, because I would just rotate the images in Inkscape and proceed. However, I now need to display these SVGs in a web browser (which does respect the EXIF Orientation tag), and thus I get different results.
Here is a screenshot showing the same SVG content in Inkscape and in Chrome.
Here is the SVG content, including the embedded image (which has an EXIF Orientation of 6).
When I embed a JPG image Inkscape does not respect the Orientation tag in the EXIF data. This has not been a problem previously, because I would just rotate the images in Inkscape and proceed. However, I now need to display these SVGs in a web browser (which does respect the EXIF Orientation tag), and thus I get different results.
Here is a screenshot showing the same SVG content in Inkscape and in Chrome.

Here is the SVG content, including the embedded image (which has an EXIF Orientation of 6).
<svg xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 120 160">
<image width="120" height="160" id="image1" xlink:href="data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/4QA8RXhpZgAATU0AKgAAAAgAAgESAAMAAAABAAYAAIdpAAQAAAABAAAAJgAAAAAAAaMBAAcAAAABMQAAAP/bAEMACAYGBwYFCAcHBwkJCAoMFA0MCwsMGRITDxQdGh8eHRocHCAkLicgIiwjHBwoNyksMDE0NDQfJzk9ODI8LjM0Mv/bAEMBCQkJDAsMGA0NGDIhHCEyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMv/AABEIAHgAoAMBIgACEQEDEQH/xAAfAAABBQEBAQEBAQAAAAAAAAAAAQIDBAUGBwgJCgv/xAC1EAACAQMDAgQDBQUEBAAAAX0BAgMABBEFEiExQQYTUWEHInEUMoGRoQgjQrHBFVLR8CQzYnKCCQoWFxgZGiUmJygpKjQ1Njc4OTpDREVGR0hJSlNUVVZXWFlaY2RlZmdoaWpzdHV2d3h5eoOEhYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4eLj5OXm5+jp6vHy8/T19vf4+fr/xAAfAQADAQEBAQEBAQEBAAAAAAAAAQIDBAUGBwgJCgv/xAC1EQACAQIEBAMEBwUEBAABAncAAQIDEQQFITEGEkFRB2FxEyIygQgUQpGhscEJIzNS8BVictEKFiQ04SXxFxgZGiYnKCkqNTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqCg4SFhoeIiYqSk5SVlpeYmZqio6Slpqeoqaqys7S1tre4ubrCw8TFxsfIycrS09TV1tfY2dri4+Tl5ufo6ery8/T19vf4+fr/2gAMAwEAAhEDEQA/APf6KKKACiiigAooooAKKKKACiiigAooooAKKKKACiiigAooooAKKKKACiiigAooooAKKKKACiiigAooooAKKKKACiiigBKK4/4l+NW8CeE21WK3W4uZZlt4EfO3eQTlsc4AVv0rm/CXj/xSPHUHhPxnpdra3d7bfabV7Y9grMQwyR0Rx2wV75p2uL5HqtFFFIYUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFAHnnxh8I6r4z8JWmnaPHG9xFfpOwkcINojkU8n3YVxN54Z+LF744sPFsthow1GxgNvEqy/uypDjkbs5/eN39K9Y8YeFIvF+kxafLqN7YLHOJ/Ns3COSFZdpODx82fwFcQfgdZ4OPFviHOOM3Kn+lL+ugf11Os8FzeNpft3/CYW2nQ48v7L9jOc/e37uT/s4/Gurryj4L6xqk0vifw7qWoPqK6JeCGC6kYszqWkXGTnj93kcn71er02IWiiigYUUUUAFFFFABRRRQAUUUUAFFZ2s65pfh7T3v9Xv4LO1XI3zPjccE7VHVmwDhRknHAqPQPEWkeKdLXUtFvku7QuULqCpVh1DKQCp6HBA4IPQigDVooooAKKKKAOd8YeGpvFWkxWMGs3mlNHOJjPaMVdgFYbTgjj5s/gK4r/hTd+eH+IHiEqeo85uR/wB9V6tRRr0YadjmvBfgjSfAukvY6WJHMr+ZNPMQXkboMkAcDsB/MknpaKKWwPUWiiimAUUUUAFFFcP4n+Lfg7wrLNbXWp/ar6H71pZL5rg7tpUnhFYEHKswIx05GQDuKinnhtbeW4uJUhgiQySSSMFVFAySSeAAO9fOviD9oLXdYlGn+E9K+xSSy+XFM4FxPJlhs2pjarHkEfP97g8ZOXZ/DX4l/EO9guvEc93bWjO8gm1SU5i3OA4jgzlCcZC4RSFHIGKAPU/EXx48HaN5kVjLPq90vmKFtUxGHXoDI2AVJ6Mm/gE+mfMNW+Mfj3xpeS2Xhexns4fKYtb6dCbifYQqlmfbkYJ4ZQuNw5Jwa9D0D9nvwpp0atq813q85Qq4ZzBFndkMqodwIAxy5HJOOmPU7Gws9Ms0s7C0gtLWPOyGCMRouTk4UcDkk/jQB8o+IPhf4xs/DmreLfFdx5c1v5YKT3H2iecl44wSwJAXDHksT8mMYOa9X/Zx/wCSeah/2FZP/RUVd3498NTeL/BGp6Fb3EdvPcohjkkBK7kdXAOOQCVxnnGc4OMV886b8N/jBo1u1vpcOpWMDPvaO11eOJSxAGSFlAzgAZ9hQB9V0V8wf8Ib8c/+frXP/B6v/wAeo/4Q345/8/Wuf+D1f/j1AH0/RXzB/wAIb8c/+frXP/B6v/x6j/hDfjn/AM/Wuf8Ag9X/AOPUAfT9FfMH/CG/HP8A5+tc/wDB6v8A8eo/4Q345/8AP1rn/g9X/wCPUAfT9FfHmuax8S/BOs21vrGu6zbXuxbmOOTUjOrLuIBIDspGVI2nrjkYNfYdABRRRQAV438R/jfN4R8QXnh/S9HjmvLdIy11dSHywzAPgRryw2sOdy8npgc+yVz3iPwR4a8W+Wdc0iC7kjwFlyY5ABnC71Ibb8xO3OMnOKAPmG21Px98V9RGlPrv2jzNkT28t3HbRsuS+7yQV8zbgsSqswCj2r0/w7+zjpdt5c3iHVp72QeW5t7VfKjBHLoWOWdT0yNhxnpninr/AOzbCUaTw5rjq4QBYNRUMGbdyTIgG0beg2HkdeeOQXUvi38MY1N0upJp8KRFkuALu1SNW2qm8FhGD93Csp5X/ZoA+kvD3hXQ/Ctm1roemQWcbY3lAS8mCSN7nLNjccZJxnA4rZrw/wAO/tHaXc+XD4h0meykPlobi1bzYyTw7lThkUdcDecZ6459X8PeKtD8VWbXWh6nBeRrjeEJDx5JA3ocMudpxkDOMjigDZooooAKKK5//hO/CH/Q16H/AODGH/4qgDoKK5//AITvwh/0Neh/+DGH/wCKo/4Tvwh/0Neh/wDgxh/+KoA6Ciuf/wCE78If9DXof/gxh/8AiqP+E78If9DXof8A4MYf/iqAOgorn/8AhO/CH/Q16H/4MYf/AIqj/hO/CH/Q16H/AODGH/4qgDwD9o7/AJKHp/8A2Co//RstfT9fKnx71bTdZ8dWNxpeoWl9Aumxo0lrMsqhvNlOCVJGcEce9fVdABRRRQAUUUUAFFFFAHD+J/hJ4O8VSzXN1pn2W+m+9d2TeU5O7cWI5RmJJyzKSc9eBjyjxB+z7rujyjUPCeq/bZIpfMihci3njww2bXztZhySfk+7wOcD6PooA+XLP4lfEv4eXsFr4jgu7m0V3jEOqRHMu1wXMc+MuRnAbLqAw4IxXo+gftCeFNRjVdXhu9InCFnLIZ4s7sBVZBuJIOeUA4Iz0z6vPBDdW8tvcQpNBKhSSORQyupGCCDwQR2rzTxF8B/B2teZLYxT6RdN5jBrV8xl26ExtkBQeips4JHpgAufFjVobr4M61f6TqEc0EqRotxaTBldTOiOAynBBBZSPqDXinw4+D//AAsDw9cat/bv2Dybtrbyvsnm5wiNuzvX+/jGO1WPEnwN8Y+HvtJ0aT+17CSIiU2zeVIyLtfa8RPzfMMhVL5KA4BwK9X+A+h6poXgK4i1awnspp9QkmjinXY+zZGuSp5XlG6gevQigDj/APhmX/qbv/Kb/wDbaP8AhmX/AKm7/wApv/22voCigD5//wCGZf8Aqbv/ACm//baP+GZf+pu/8pv/ANtr6AooA+f/APhmX/qbv/Kb/wDbaP8AhmX/AKm7/wApv/22voCigDwSD9miFbiJrjxU8kAcGRI7AIzLnkBjIQDjvg49DXvdFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAf/2Q=="></image>
</svg>
Good to see you have contributed to the bug report / feature request. 👍