If you want to keep a tag armed (so to log open/close in event history) but only get notification when it is opened after hours, you can enable this applet which will use Pushover to send you important notification (you can even configure Pushover to repeat the notification).