Home » RDBMS Server » Server Administration » Ora-48181. no space left on the device (oracle 11 g r2 RAC of 2 nodes, solaris 10 and ASM)
Ora-48181. no space left on the device [message #680506] Tue, 19 May 2020 04:43 Go to next message
janakors
Messages: 227
Registered: September 2009
Senior Member
Hi,
i have 11.2.0.4

i am receiving ORA-48181 with no space left on device, followed by
Error: Direct connection failure with ASM
WARNING:ASM communication error : op 0 state 0x0 (15055)
the error is due to /u01 is full but when apply df -ah so it still showing 88 GB available. the trace file located at

/u01/app/oracle/diag/asm/+asm/+ASM2/trace

what can be the reason? please guide

Regards



[Updated on: Tue, 19 May 2020 05:24]

Report message to a moderator

Re: Ora-48181. no space left on the device [message #680533 is a reply to message #680506] Tue, 19 May 2020 15:39 Go to previous messageGo to next message
EdStevens
Messages: 1248
Registered: September 2013
Senior Member
janakors wrote on Tue, 19 May 2020 04:43
Hi,
i have 11.2.0.4

i am receiving ORA-48181 with no space left on device, followed by
Error: Direct connection failure with ASM
WARNING:ASM communication error : op 0 state 0x0 (15055)
the error is due to /u01 is full but when apply df -ah so it still showing 88 GB available. the trace file located at

/u01/app/oracle/diag/asm/+asm/+ASM2/trace

what can be the reason? please guide

Regards



How did you determine "the error is due to /u01 is full", when the error message itself is pointing to ASM: "Error: Direct connection failure with ASM"
Re: Ora-48181. no space left on the device [message #680534 is a reply to message #680533] Wed, 20 May 2020 00:12 Go to previous messageGo to next message
janakors
Messages: 227
Registered: September 2009
Senior Member
I have searched the error code on the internet and then check my operating sys messages. /var/adm/messages.0 . it says that /u01 is full

please reply

Re: Ora-48181. no space left on the device [message #680536 is a reply to message #680534] Wed, 20 May 2020 01:48 Go to previous messageGo to next message
John Watson
Messages: 8344
Registered: January 2010
Location: Global Village
Senior Member
Er.... Perhaps /u01 is full? What does df actually tell you?

Re: Ora-48181. no space left on the device [message #680537 is a reply to message #680536] Wed, 20 May 2020 01:56 Go to previous messageGo to next message
janakors
Messages: 227
Registered: September 2009
Senior Member
it shows 53 gb is available
Re: Ora-48181. no space left on the device [message #680538 is a reply to message #680537] Wed, 20 May 2020 01:58 Go to previous messageGo to next message
John Watson
Messages: 8344
Registered: January 2010
Location: Global Village
Senior Member
copy/paste, perhaps? The error as well? THe message in messages?
Re: Ora-48181. no space left on the device [message #680555 is a reply to message #680538] Thu, 21 May 2020 02:45 Go to previous messageGo to next message
janakors
Messages: 227
Registered: September 2009
Senior Member
message is as follows which is reapetd many times but currently this message is gone
May 20 14:08 xxxx ufs:  [ID 845546 kern.Notice]  NOTICE:alloc:  /u01:  file system full
Re: Ora-48181. no space left on the device [message #680559 is a reply to message #680555] Thu, 21 May 2020 12:40 Go to previous messageGo to next message
John Watson
Messages: 8344
Registered: January 2010
Location: Global Village
Senior Member
And the df command? The Oracle error?
Re: Ora-48181. no space left on the device [message #680603 is a reply to message #680559] Sun, 24 May 2020 15:58 Go to previous messageGo to next message
janakors
Messages: 227
Registered: September 2009
Senior Member
oracle error
Non Critical error ORA-48181 caught while writing to trace file "/u01/app/oracle/diag/rdbms/mygrid/mygrid12/trace/mygrid12_m000_210009.trc"
Error Messages: SVr4 Error: 28 : No space left on device 
writing to the above trace file is disabled for now on 
Error: Direct connection failure with ASM
WARNING:ASM communication error : op 0 state 0x0 (15055)

df -ah

/dev/dsk/c0t500xxxxxxd0s4   439G   381G   54G   88%     /u01
now above 54G is free space


current development are when i tried to issue any query on SQL prompt i get following

ORA-09817: Write to audit file failed


please reply where to delete the old files

Re: Ora-48181. no space left on the device [message #680604 is a reply to message #680603] Mon, 25 May 2020 01:22 Go to previous messageGo to next message
John Watson
Messages: 8344
Registered: January 2010
Location: Global Village
Senior Member
This is like getting blood out of a stone.

The COMPLETE output of df, showing all the file systems, not just the one to which you think the audit records are being written.
Re: Ora-48181. no space left on the device [message #680610 is a reply to message #680604] Mon, 25 May 2020 12:09 Go to previous messageGo to next message
janakors
Messages: 227
Registered: September 2009
Senior Member
Mr John i dont have copy paste facilty so i need to write it manually and as the system messages saying that it /u01 then i shown that . now all other file system are not 100% full. u can trust that. u saw the alert log errors , so if u want to help here the is time. all other file system have free space so if you can point some specific file system the tell me i will check it for you.


if you want to help, then help


regards

Re: Ora-48181. no space left on the device [message #680611 is a reply to message #680610] Mon, 25 May 2020 14:14 Go to previous messageGo to next message
janakors
Messages: 227
Registered: September 2009
Senior Member
Now the issue has escalated and following error is reported in alert log


Master Archival Failure:313
ARCH: Archival stopped, error occured
ORA-00313: open failed for members of log group 4 of thread 2
ORA-00312: online log 4 thread 2: '+TG1/mygrid/redo04_2.log
ORA-17503:ksfdopn:2 Failed to open file +Tg1/mygrid/redo04_02.log
ORA-15055: unable to connect to ASM instance 
ORA-09925: unable to create audit trail



any help
Re: Ora-48181. no space left on the device [message #680699 is a reply to message #680611] Tue, 02 June 2020 00:54 Go to previous messageGo to next message
Michel Cadot
Messages: 67363
Registered: March 2007
Location: Nanterre, France, http://...
Senior Member
Account Moderator

Crossref: https://www.dba-village.com/village/dvp_forum.OpenThread?ThreadIdA=94986&SkipA=0

Re: Ora-48181. no space left on the device [message #680731 is a reply to message #680699] Thu, 04 June 2020 06:59 Go to previous message
janakors
Messages: 227
Registered: September 2009
Senior Member
yes Michel
i put over there as well to have some help but my issue still persists. i have now rebooted the machine so if there are some file handles busy so they will be relieved and after 8 hrs of reboot. ORA-48181 appear again but currently the instance is up and might die again in few more days

u have any point?


Regards
Previous Topic: how to verify gather schema statistics
Next Topic: SQL text history
Goto Forum:
  


Current Time: Mon Sep 21 07:15:58 CDT 2020