Using Community Checking

This guide describes how to use Scripture Forge for community checking. The basic steps are as follows:

1. Connect a Paratext project to Scripture Forge
2. Create or import questions for checkers to answer
3. Invite people to check your project
4. Receive and interact with responses to the questions
5. Sync the project so answers show up as notes in Paratext

Connect a Paratext project to Scripture Forge

1. Go to scriptureforge.org and click Log in.
2. On the log in page, click Log in with Paratext.
3. Log in through Paratext and authorize Scripture Forge to access your Paratext account.
4. When you’re redirected back to Scripture Forge, go to the connect project page. If you don’t have any projects yet you’ll be sent there automatically. If you already have projects in Scripture Forge, click the project selector in the top left corner, and click Connect project.
5. The connect project page shows a list of projects you have access to in Paratext. Select the project you want to connect from the list.
6. Make sure the Enable Community Checking checkbox is selected. Don’t worry about the source text right now. That setting can be changed later on the project settings page.
7. Click Connect. Within less than a minute you should be taken to the project in Scripture Forge.

Add Questions to the Project

In order to get feedback on your translation, you’ll need to add comprehension checking questions. You can import questions created by someone else, or create your own.

note

Currently the only way to get feedback from community checkers is to ask checking questions. Some project administrators have asked for checkers to be able to add comments to the text even without a question present. If that’s something your project may benefit from, please voice your support for the proposal on the Scripture Forge community site.

Creating questions individually in Scripture Forge

To add questions to your project, click on Overview under the Community Checking section in the navigation sidebar. Then click on the Add Question button. A dialog will open that will allow you to create a question.

A question can apply to a single verse, or multiple verses. Type a reference into the Scripture reference box, or click the dropdown arrow to select a book, chapter, and verse. If you want the question to span multiple verses, enter an end reference in the second box. Once you’ve input a reference, the text will show up, with the verses you chose highlighted.

Type your question into the Question box. If you want to add an audio version of the question, click the Record button. You may be prompted to give permission to access your microphone. When you have finished recording, click Stop Recording. You can then play the recording to hear how it sounds. Click the Try Again button if you’re not satisfied with it. You can also upload an audio file instead of recording, if you prefer.

Click Save and your question will be added to the list of community checking questions.

Importing questions from a spreadsheet

Creating questions one by one can be tedious, so we’ve also made it possible to import questions from a spreadsheet. You can use a program such as Microsoft Excel, Google Sheets, or LibreOffice Calc to create or edit a list of questions. If you’re looking for a set of pre-made questions, consider the unfoldingWord® Translation Questions. If you go to the linked page and click on one of the files, you can then download it, open it as a spreadsheet, and edit the list of questions.

Here’s an example of how the rows in your spreadsheet should look in order to be able to import it to Scripture Forge:

Reference	Question
HEB 1:1	What does “our fathers” refer to?
HEB 1:2	What does it mean that the Son is “heir of all things”?
HEB 1:2-3	Who is the “Son” spoken of in these verses?

The spreadsheet can have more columns as well, but all columns except the “reference” and “question” columns will not be used. The TSV files published by unfoldingWord are in a slightly different format, but can be imported to Scripture Forge too.

note

The reference needs to have the book name abbreviated the same way Paratext abbreviates book names. For example, HEB 1:1 will work, but Hebrews 1:1 will not work.

If you need help getting your spreadsheet into the right format to import to Scripture Forge, we would be happy to help you. Just send an email to [email protected].

1. Save your spreadsheet as a CSV file.
2. Then in Scripture Forge, click on Overview under the Community Checking section in the navigation sidebar.
3. Then click on the Bulk import button. A dialog will open requesting for you to choose where you want to import questions from.
4. Click on Import from CSV file and select the file.
   1. If you have some rows in your file that don’t have a valid reference and question, a warning will be shown letting you know that these rows will be skipped.
   2. Otherwise you will be shown a list of questions.

Import all of questions

To import all of the questions in the CSV file, follow these steps:

1. Click the checkbox at the top of the list. This will select all the questions.
2. Click Import Selected Questions.

Import a subset of questions

You can also filter for a subset of the questions:

1. Use the Reference from and Reference to boxes to specify the verses that you want the questions to start and end at.
2. For example, if you only want to import questions for Mark 5:
   1. Put MRK 5:1 in the Reference from box.
   2. Put MRK 5:43 in the Reference to box.
3. Click the checkbox at the top of the list to select all questions. Only the questions that are shown will be selected.
4. Click Import Selected Questions.

note

You don’t have to remember that there are 43 verses in Mark 5 in order to filter for all the verses in the chapter. If you click the dropdown arrow in the Reference to box, a dialog will open allowing you to select a book, chapter, and verse. Once you select Mark 5, it will list the verses in Mark 5, and you’ll be able to select the last one, which is verse 43. Alternatively you can type MRK 5:100 in the Reference to box, and all the verses in Mark 5 will be included, even though there isn’t actually a verse 100 in Mark 5.

Importing questions from Transcelerator

Transcelerator is a plugin for Paratext that has a bank of ready-made comprehension checking questions in several major languages. Those questions can be translated within Paratext, exported to Scripture Forge, and then after a sync, imported into Scripture Forge.

To import questions from Transcelerator:

1. Download and install Transcelerator from software.sil.org/transcelerator/download.
2. From within Paratext, launch Transcelerator.
3. Within Transcelerator, open the File menu and click Produce Scripture Forge Files.
4. Type the translations of the English questions you want to use in the Translation column. For each question that’s ready, select the Confirmed check box for the questions.
5. Close Transcelerator, and do a send and receive with Paratext.
6. In Scripture Forge, in the navigation sidebar, click Synchronize. On the page that opens, click Synchronize to send and receive the Transcelerator questions from Paratext.
7. Click on Overview under the Community Checking section in the navigation sidebar. Then click on the Bulk import button.
8. A dialog will open requesting for you to choose where you want to import questions from. Click Import from Transcelerator.
9. Select the questions you want to import. The steps for doing this are exactly the same as in the section above titled Importing questions from a spreadsheet. Refer to that section for instructions on filtering for the questions you want.
10. Click Import Selected Questions and your questions will be added to the project.

Invite people to check your project

Once you have the questions on your project, it’s time to invite community checkers.

In the side bar, click Settings, and scroll down to Community Checking Settings.

User interaction settings

The first setting to consider is Allow checkers to see each other's answers. When community checkers are presented with a question, existing answers from other community checkers are not shown so that they will not influence the answer that is given. Once a question is answered, any other answers to the question will be shown, and checkers can comment on and like each other’s answers. If you don’t want this interaction and want answers from other checkers to always be hidden, turn off Allow checkers to see each other's answers.

Sharing settings

If you want community checkers to be able to invite friends to the project, make sure Allow users to invite others to the project is enabled. If this setting is off, only project admins will be able to add community checkers to the project.

If you turn this setting on, there are two sharing modes to choose from. If you select Anyone with a link, you can send people a link to the project, and anyone who clicks the link can join the project. This is ideal if you want to invite a group of people (for example, you could share the link in a Facebook or WhatsApp group). Anyone with the link will be able to send the link to anyone else to join the project. Alternatively you can select Email invitations only, and community checkers will only be able to invite friends by sending an invitation in Scripture Forge (Scripture Forge will send an email invitation to the person).

Inviting community checkers

In the side bar, click Users, and you will be presented with sharing options.

If you enabled link sharing in the previous step, there will be a link that you can copy to share the project. To copy the link, click the copy icon on the right side of the link.

If link sharing is turned off, or if you want to send email invitations to users, type the email of the user you want to invite, select the Community Checker role, and choose an invitation language. Then click Send. An email with a link will be sent to the person, who will need to click the link and sign up to join the project.

note

Community checkers need to sign up to answer questions. Some projects have found that this is too difficult of a challenge for people in some regions of the world. We’re working on making the sign up process easier.

Receive and interact with responses to the questions

To monitor community checking responses, click on Overview under the Community Checking section in the navigation sidebar. Along with a list of questions, basic statistics about responses will be shown.

To view the answers from community checkers, click on one of the books under the Community Checking section in the navigation sidebar. Then click on a question to see the answers that have been given. If you want an answer to be exported to Paratext, click Mark for export on that answer. If you don’t want to do anything further with the answer, click Resolve. This does not remove the answer, but it marks it as not needing any further action.

If you want to find answers that have not been marked for export, or marked resolved, use the filter above the list of questions to find Unreviewed answers.

If you would prefer to have all answers exported to Paratext without individually marking them for export, go to the project settings and find the Exporting Answers section. The default option is to only export Answers marked for export, but this setting can be changed to All answers or No answers.

Sync the project so answers show up as notes in Paratext

In the navigation sidebar, click Synchronize. On the page that opens, click Synchronize to send and receive changes from Paratext. Then open your project in Paratext and do a send and receive. Answers from community checkers will show up in your project as notes. Please note that if you reply to these notes in Paratext, your replies will not appear as comments on the answer in Scripture Forge.

The note will show the original question, the name of the community checker who answered, and the answer itself, as shown below.

Notes generated from community checking answers will have a unique note tag, with an icon that is different from other notes in your Paratext project. You can change the icon by editing the note tag. For details, see the Paratext help article on custom note tags. You can also filter notes by their note tag, allowing you to show only community checking responses, or hide them from view altogether.

note

Currently audio answers show up in Paratext but the audio cannot be played. In order to play the audio from an answer it has to be opened in Scripture Forge. This may be improved in the future.

Feedback

If you have questions, problems, or suggestions, please reach out to the Scripture Forge team at community support site, which allows others to participate in the conversation. We value your feedback and frequently make changes or fix problems at the request of our users.