为xenops add-hook导致emacs-server启动出错?

最近试着用xenops替代org-fragtog,为了在latex mode下自动启用xenops,我用了下面的use-package段落:

(use-package xenops
      :init
      (add-hook 'latex-mode-hook #'xenops-mode)
      (add-hook 'LaTeX-mode-hook #'xenops-mode)
      ;;   (add-hook 'org-mode-hook #'xenops-mode)
      )

上面的配置可以正常启动emacs,Messages buffer的内容如下

Starting new Ispell process aspell with default dictionary...done
Clearing removed files...done
Processing modified files...done
[yas] Prepared just-in-time loading of snippets successfully.
Starting Emacs daemon.
Restarting server

而如果我添加了org-mode的hook:

(use-package xenops
      :init
      (add-hook 'latex-mode-hook #'xenops-mode)
      (add-hook 'LaTeX-mode-hook #'xenops-mode)
      (add-hook 'org-mode-hook #'xenops-mode)
      )

emacs -nw可以正常启动emacs,而使用emacsclient -nw -c -a ""就会卡在

Clearing removed files...
Clearing removed files...done
Processing modified files...
Processing modified files...done
[yas] Prepared just-in-time loading of snippets successfully.

请问这是什么导致的?该怎样排查问题?虽然目前定位到这一行代码,但是完全无法理解为什么给org-mode加个hook就会导致server启动出错