{"id":38,"date":"2014-08-06T00:25:40","date_gmt":"2014-08-05T16:25:40","guid":{"rendered":"http:\/\/www.theinsecurewire.com\/?p=38"},"modified":"2014-08-06T00:25:40","modified_gmt":"2014-08-05T16:25:40","slug":"riverbed-steelhead-winbindd-bug-rios-8-6","status":"publish","type":"post","link":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/","title":{"rendered":"Riverbed Steelhead Winbindd bug in RiOS 8.6"},"content":{"rendered":"

Recently i noticed an alarm issue with our Steelhead fleet. At random times the Steelhead appliances were losing trust relationship with the Windows Domain they are members of. This can be really bad, when the main reason your have a product like Riverbed Steelhead is cache chatty protocols such as Microsoft CIFS\/SMB. A further look into the logs on the Steelhead appliances – we have one at every site i was seeing the following log entry:<\/p>\n

Jul 14 10:31:36 rb-flee sport[9207]: [domain_auth\/trusted_domains.WARN] – {- -} Failed to update trusted domains : Failed to communicate with\u00a0winbindd<\/span>\u00a0<\/span><\/p>\n

 <\/p><\/blockquote>\n

Further entries in the logs reported that CIFS\u00a0and SMB optimizations will be disabled whilst the trust with the domain is down. This is very bad losing all application layer optimization for pretty much anything file transfer related as like many organisations we use Active Directory.<\/p>\n

So the troubleshoot this issue, the first thing i did was make sure the steelheads could hit up the site local domain controller for kerberos authentication. I wanted to make sure there was no layer 2 or layer 3 connectivity issue. To do this you can issue a telnet command from the RiOS CLI:<\/p>\n

\n
\n
SH > en
\nSH # telnet 10.10.10.1 88<\/div>\n<\/div>\n<\/blockquote>\n
If the connection establishes there is no connectivity issue between the steelhead and the Windows DC.<\/div>\n
At this point i opened up a ticket with Riverbed Support and they informed me of bug id #167210 – a memory leak in the winbindd binary that causes such issues.A quick workaround for the solution was to run a cron job on the steelheads to restart the winbindd process nightly. See the below snippet:<\/p>\n<\/div>\n
\n
SH # (config) job 1 command 1 “en”
\nSH # (config) job 1 command 2 “pm process winbind restart”
\nSH # (config) job 1 comment “This job will restart winbind service once every day”
\nSH # (config) job 1 date-time 00:00:00 2014\/08\/06
\nSH # (config) job 1 enable
\nSH # (config) job 1 name “Restart-Winbind”
\nSH # (config) job 1 recurring “86400”<\/div>\n<\/blockquote>\n
With the daily restart of the winbind process i havent seen it hang on any of steelheads – so a daily restart seems to be a good figure. I’ve been informed by Riverbed TAC that this bug should be resolved in the next release.<\/div>\n
<\/div>\n
Originally published as ‘Riverbed Steelhead Winbindd bug in RiOS 8.6’<\/div>\n","protected":false},"excerpt":{"rendered":"

Recently i noticed an alarm issue with our Steelhead fleet. At random times the Steelhead appliances were losing trust relationship with the Windows Domain they…<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19],"tags":[],"class_list":["post-38","post","type-post","status-publish","format-standard","hentry","category-wan-acceleration"],"acf":[],"yoast_head":"\nRiverbed Steelhead Winbindd bug in RiOS 8.6<\/title>\n<meta name=\"description\" content=\"Riverbed Steelhead Winbindd bug in RiOS 8.6\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Riverbed Steelhead Winbindd bug in RiOS 8.6\" \/>\n<meta property=\"og:description\" content=\"Riverbed Steelhead Winbindd bug in RiOS 8.6\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/\" \/>\n<meta property=\"og:site_name\" content=\"Insecure Wire\" \/>\n<meta property=\"article:published_time\" content=\"2014-08-05T16:25:40+00:00\" \/>\n<meta name=\"author\" content=\"nikonau\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/insecurewire\" \/>\n<meta name=\"twitter:site\" content=\"@insecurewire\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"nikonau\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/\"},\"author\":{\"name\":\"nikonau\",\"@id\":\"https:\/\/www.insecurewi.re\/#\/schema\/person\/8ba08b41fc754b971a948ead6ccb777d\"},\"headline\":\"Riverbed Steelhead Winbindd bug in RiOS 8.6\",\"datePublished\":\"2014-08-05T16:25:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/\"},\"wordCount\":376,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.insecurewi.re\/#organization\"},\"articleSection\":[\"WAN Acceleration\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/\",\"url\":\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/\",\"name\":\"Riverbed Steelhead Winbindd bug in RiOS 8.6\",\"isPartOf\":{\"@id\":\"https:\/\/www.insecurewi.re\/#website\"},\"datePublished\":\"2014-08-05T16:25:40+00:00\",\"description\":\"Riverbed Steelhead Winbindd bug in RiOS 8.6\",\"breadcrumb\":{\"@id\":\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.insecurewi.re\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Riverbed Steelhead Winbindd bug in RiOS 8.6\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.insecurewi.re\/#website\",\"url\":\"https:\/\/www.insecurewi.re\/\",\"name\":\"Insecure Wire\",\"description\":\"A Network Engineer\u2019s Perspective.\",\"publisher\":{\"@id\":\"https:\/\/www.insecurewi.re\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.insecurewi.re\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.insecurewi.re\/#organization\",\"name\":\"Insecure Wire\",\"url\":\"https:\/\/www.insecurewi.re\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.insecurewi.re\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.insecurewi.re\/wp-content\/uploads\/2023\/10\/cloud.png\",\"contentUrl\":\"https:\/\/www.insecurewi.re\/wp-content\/uploads\/2023\/10\/cloud.png\",\"width\":32,\"height\":32,\"caption\":\"Insecure Wire\"},\"image\":{\"@id\":\"https:\/\/www.insecurewi.re\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/insecurewire\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.insecurewi.re\/#\/schema\/person\/8ba08b41fc754b971a948ead6ccb777d\",\"name\":\"nikonau\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.insecurewi.re\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2d1b9d9dc90da4f6d3da31b870f418c6b3553ba9be48d53e8ee3a35b0adb1d35?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2d1b9d9dc90da4f6d3da31b870f418c6b3553ba9be48d53e8ee3a35b0adb1d35?s=96&d=mm&r=g\",\"caption\":\"nikonau\"},\"sameAs\":[\"https:\/\/x.com\/https:\/\/twitter.com\/insecurewire\"],\"url\":\"https:\/\/www.insecurewi.re\/index.php\/author\/nikon\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Riverbed Steelhead Winbindd bug in RiOS 8.6","description":"Riverbed Steelhead Winbindd bug in RiOS 8.6","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/","og_locale":"en_US","og_type":"article","og_title":"Riverbed Steelhead Winbindd bug in RiOS 8.6","og_description":"Riverbed Steelhead Winbindd bug in RiOS 8.6","og_url":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/","og_site_name":"Insecure Wire","article_published_time":"2014-08-05T16:25:40+00:00","author":"nikonau","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/insecurewire","twitter_site":"@insecurewire","twitter_misc":{"Written by":"nikonau","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#article","isPartOf":{"@id":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/"},"author":{"name":"nikonau","@id":"https:\/\/www.insecurewi.re\/#\/schema\/person\/8ba08b41fc754b971a948ead6ccb777d"},"headline":"Riverbed Steelhead Winbindd bug in RiOS 8.6","datePublished":"2014-08-05T16:25:40+00:00","mainEntityOfPage":{"@id":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/"},"wordCount":376,"commentCount":0,"publisher":{"@id":"https:\/\/www.insecurewi.re\/#organization"},"articleSection":["WAN Acceleration"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/","url":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/","name":"Riverbed Steelhead Winbindd bug in RiOS 8.6","isPartOf":{"@id":"https:\/\/www.insecurewi.re\/#website"},"datePublished":"2014-08-05T16:25:40+00:00","description":"Riverbed Steelhead Winbindd bug in RiOS 8.6","breadcrumb":{"@id":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.insecurewi.re\/index.php\/2014\/08\/06\/riverbed-steelhead-winbindd-bug-rios-8-6\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.insecurewi.re\/"},{"@type":"ListItem","position":2,"name":"Riverbed Steelhead Winbindd bug in RiOS 8.6"}]},{"@type":"WebSite","@id":"https:\/\/www.insecurewi.re\/#website","url":"https:\/\/www.insecurewi.re\/","name":"Insecure Wire","description":"A Network Engineer\u2019s Perspective.","publisher":{"@id":"https:\/\/www.insecurewi.re\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.insecurewi.re\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.insecurewi.re\/#organization","name":"Insecure Wire","url":"https:\/\/www.insecurewi.re\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.insecurewi.re\/#\/schema\/logo\/image\/","url":"https:\/\/www.insecurewi.re\/wp-content\/uploads\/2023\/10\/cloud.png","contentUrl":"https:\/\/www.insecurewi.re\/wp-content\/uploads\/2023\/10\/cloud.png","width":32,"height":32,"caption":"Insecure Wire"},"image":{"@id":"https:\/\/www.insecurewi.re\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/insecurewire"]},{"@type":"Person","@id":"https:\/\/www.insecurewi.re\/#\/schema\/person\/8ba08b41fc754b971a948ead6ccb777d","name":"nikonau","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.insecurewi.re\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2d1b9d9dc90da4f6d3da31b870f418c6b3553ba9be48d53e8ee3a35b0adb1d35?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2d1b9d9dc90da4f6d3da31b870f418c6b3553ba9be48d53e8ee3a35b0adb1d35?s=96&d=mm&r=g","caption":"nikonau"},"sameAs":["https:\/\/x.com\/https:\/\/twitter.com\/insecurewire"],"url":"https:\/\/www.insecurewi.re\/index.php\/author\/nikon\/"}]}},"_links":{"self":[{"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/posts\/38","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/comments?post=38"}],"version-history":[{"count":0,"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/posts\/38\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/media?parent=38"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/categories?post=38"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.insecurewi.re\/index.php\/wp-json\/wp\/v2\/tags?post=38"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}