A=⎡⎢⎣11112−32−13⎤⎥⎦A2=⎡⎢⎣421−38−147−314⎤⎥⎦
A3=⎡⎢⎣871−2327−6932−1358⎤⎥⎦
Now,
A3−6A2+5A+11I
=⎡⎢⎣871−2327−6932−1358⎤⎥⎦+(−6)⎡⎢⎣421−38−147−314⎤⎥⎦+5⎡⎢⎣11112−32−13⎤⎥⎦+11⎡⎢⎣100010001⎤⎥⎦
=⎡⎢⎣871−2327−6932−1358⎤⎥⎦+⎡⎢⎣−24−12−618−4884−4218−84⎤⎥⎦+⎡⎢⎣555510−1510−515⎤⎥⎦+⎡⎢⎣110001100011⎤⎥⎦
=⎡⎢⎣871−2327−6932−1358⎤⎥⎦+⎡⎢⎣−8−7−123−2769−3213−58⎤⎥⎦
=⎡⎢⎣000000000⎤⎥⎦=0
Now,
A3−6A2+5A+11I=0
Operating A−1 on both sides
A2−6A+5I+11A−1=0 (AA−1=I)
11A−1=−A2+6A−5I
11A−1=−⎡⎢⎣421−38−147−314⎤⎥⎦+6⎡⎢⎣11112−32−13⎤⎥⎦−5⎡⎢⎣100010001⎤⎥⎦
11A−1=⎡⎢⎣−3459−1−45−3−1⎤⎥⎦
A−1=⎡⎢
⎢
⎢
⎢
⎢
⎢
⎢⎣−311411511911−111−411511−311−111⎤⎥
⎥
⎥
⎥
⎥
⎥
⎥⎦