Skip to content

Recognized/ScreencastEditor

Repository files navigation

drawing ScreencastEditor

Intellij IDEA plugin for editing IDE screencasts.

Download.

Test GUI Framework and ScreencastRecorder plugins are required to be installed.


Overview

ScreencastRecorder allows user to record and reproduce screencasts within IDE.

Recorded screencasts can be edited with ScreencastEditor plugin.

Screencast is a zip (but with .scs extension) of:

  1. UI automation script
  2. Recorded audio (*)
  3. Imported audio (*)
  4. Transcript of zipped audio (*)

(*) - optional

Features

✅ Built-in audio editor and player. (Currently supports WAV and MP3 formats).

✅ Transcript based mode of audio editing.

✅ If transcript is absent it can be obtained by transcribing recorded speech using external speech recognition service. (Now, only Google Speech-to-text API is supported).

✅ Visual editor of script's actions' timings.

✅ Script can be edited as regular Kotlin file without time offsets, ScreencastEditor will automatically try to guess missing offsets.

editor1

Usage


Recording and reproducing

See ScreencastRecorder's page for guide.

Editing screencast

Open screencast:

  1. Tools menu → drawing Screencast Editordrawing Open Screencast
  2. Right click on file in Project Tree → drawing Open Screencast

Editor:

  • Undo. (Standard Undo shortcut)
  • Redo. (Standard Redo shortcut)
  • transcript Open transcript. Start recognition if transcript is not yet known.
  • transcript Open UI script.
  • Import audio. (It will be played instead of audio recorded by plugin during screencast replay).
  • Save changes made to this screencast.

  • play pause Play whole audio file or selected range only. (Control+P)
  • stop Stop playing audio. (Control+Alt+P)
  • cut Cut selected range. (Standard Cut shortcut)
  • unmute Unmute selected range.
  • mute Mute selected range. (Control+M)
  • Zoom in. (Control+Plus)
  • Zoom out. (Control+Minus)
  • Toggle drag mode. (Drag whole audio or script along time axis).

  • Hold Control and drag with Left Mouse Button or click to select audio range by words.
  • Hold Shift and drag Left Mouse Button to select range precisely (not by words).
  • Drag word's or script's borders with Left Mouse Button to change their time range.

Transcript in editor can be edited via refactoring actions:

  • Exclude: Control+Alt+E
  • Mute: Control+Alt+M
  • Include: Control+Alt+I
  • Concatenate (selected words): Control+Alt+C

Recognition

In order to use speech recognition you need to obtain key to Service Account in Google Cloud Platform.

Visit this page and do the first step (Set up a GCP Console Project, create service account and download private JSON key).

Before using recognition in plugin you will need to set this key.

Setting key: Tools menu → Screencast EditorGoogle Speech KitSet credentials (choose downloaded JSON key)

Service account must have rights to access Speech-to-Text API and to create files in Google Cloud Storage (in order to temporarily store long audio files).

You may manage accounts' rights on this page.