Forgot your password?
WG11 (CMI)
WG11 (CMI) Meeting Minutes
Minutes: January 28 WG11 telecon
- Approval Agenda/Minutes last meeting
- ADL, AICC, IEEE LTSC, LETSI updates
WG11: Update on SC36
WG11: Update from IEEE SA on multi-party collaboration
- WG participation, invited experts, and collaboration with LETSI
- WG11 scope and relation to other activities
Attending
Avron Barr
Tia Benson-Bond
Don Holmes
Scott Lewis
Kraig Mentor
Frank Polster
Tyde Richards (convener)
Schawn Thropp
Guy Tourigny
Kent Weeks
Crispin Weston
- Approval Agenda/Minutes last meeting
Agenda, Minutes approved.
- ADL, AICC, IEEE LTSC, LETSI updates
LETSI has transitioned from being an IEEE-ISTO program to being a separate, non-profit organization with the new name of the LETSI foundation.
Tyde spoke with the SC36 chair about WG11 input. Due to lack of participation SC36 no longer has a US national body. SC36, however, is thriving with significant participation by China. There will not be formal liaison reports at the March meeting. WG11 will submit an invitation to participate in the data model revision to WG4 in SC36. Crispin will be attending the March meeting on behalf of BSI and can represent WG11 if needed.
The IEEE SA is working to arrange a telecon do discuss using the IEEE Connections program as a vehicle to coordinate a multi-part collaboration. This will be a follow-up to the IP discussions between the IEEE SA and ADL, the AICC, IEEE LTSC and LETSI.
- WG participation, invited experts, and collaboration with LETSI
The IEEE SA recently revised WG policies and procedures to discourage the public distribution of draft standards. Moving forward, drafts should only be distributed to WG members. This is contrary to historic IEEE LTSC practice. It implies that WG11 invited experts should be WG11 members. Don, as IEEE LTSC chair, has authorized the selective waiving of LTSC fees for invited experts, in particular for non-English speakers from foreign countries. Since the revision is a joint activity with LETSI, if also implies that LETSI participants have WG11 privileges. There is discussion about according LETSI participants WG11 membership privileges.
Moving forward WG11 members are encouraged to identify parties with special expertise who we would like to involve in the WG.
The LETSI collaboration raises the challenge of very different assumptions about openness and intellectual property. There are real concerns that will need to be worked through to operationalize the collaboration.
- WG11 scope and relation to other activities
WG11 is an approved IEEE SA project with a document that describes the scope and other aspects of the project. The scope both constrains and allows considerable latitude in what the WG will actually do. We discussed issues related to clarifying the scope, in particular the relationship to ADL and AICC activities. No closure was reached. Topics discussed included:
The relationship to AICC CMI 5.0, a need to understand what it actually is and the potential for collaboration.
Will ADL or AICC be customers for the revision?
Should WG11 activity be halted until the ADL and the AICC clarify their plans?
Does the revision actually need to include an extension mechanism?
The role of an extension mechanism in encouraging experimentation.
What are the IP constraints that follow from putting material in the standard.
Division of labor with LETSI.
Procedural complexity of working through the IEEE.
------------------------------------------------------------------------------------------------------
Minutes: January 21 WG11 telecon
- Approval Agenda/Minutes last meeting
- ADL, AICC, IEEE LTSC, LETSI updates
- Discussion: Review WG11 wiki
- Discussion: Identify experts and communities for comment solicitation
Attending
Avron Barr
Tia Benson-Bond
Ed Cohen
Don Holmes
Scott Lewis
David Mallette
Kraig Mentor
Frank Polster
Tyde Richards (convener)
Schawn Thropp
Guy Tourigny
Kent Weeks
Crispin Weston
- Approval Agenda/Minutes last meeting
Agenda, Minutes approved.
- ADL, AICC, IEEE LTSC, LETSI updates
There will be an AICC meeting at the ADL Co-lab in Alexandria, VA, on February 10th-11th.
- Discussion: Review WG11 wiki
We reviewed the revised WG11 wiki. The wiki material makes some assumptions about how the WG will collaborate with external parties, in particular invited experts and solicitation of use cases. As the WG moves forward, these assumptions will need to be clarified, and the wiki update to reflect the clarifications.
Participants on the call were asked to clarify if they wished to be listed on the wiki as WG members, observers, or not listed. The "Members & Observers" section of the wiki has been accordingly updated.
Aspects of the "Revision" section of the wiki prompted a discussion about what it is in scope for WG11 to actually do and how that relates to other activities. We agreed to pursue this at the next telecon.
- Discussion: Identify experts and communities for comment solicitation
We began discussion about involving invited experts to review a particular aspects of the data model revision. Two parties were previously approached, and accepted, an invitation to review the revision from the perspectives of Japanese and Arabic adoption.
------------------------------------------------------------------------------------------------------
Minutes: January 14 WG11 telecon
- Approval Agenda/Minutes last meeting
- ADL, AICC, IEEE LTSC, LETSI updates
- Discussion: comment solicitation on data model
Attending
Avron Barr
Don Holmes
Scott Lewis
David Mallette
Frank Polster
Tyde Richards (convener)
Schawn Thropp
Kent Weeks
- Approved: Agenda. Minutes last meeting.
- ADL, AICC, IEEE LTSC, LETSI updates
Annual membership dues for the IEEE LTSC are due. The $25 annual fee enables voting participation in WG11. Parties who paid 2010 dues near the end of the year do not need to pay. Scott will send a reminder to the WG11 reflector.
- Discussion: comment solicitation on data model
A document was distributed for the telecon that contained a basic set of information to support the 1484.11.1 data model revision. It contained:
- a complete synopsis of the data model
- the scope of the revision from the approved IEEE "PAR"
- the intent to co-develop the standard with LETSI from the approved IEEE "PAR"
- the intent to consider ISO-IEC standardization from the approved IEEE "PAR"
- comments received thus far
Participants discussed updating the WG11 wiki with this and additional information to support the data model revision. We recommended:
- public access to a data model synopsis and submitted comments
- a FAQ about the data model revision
- posting privileges for WG11 members and observers
David suggested some issues for the FAQ from an implementor's perspective and will submit a write-up before the next telecon.
We discussed having the FAQ clarify the relationship of the revision to ADL, AICC and LETSI activities using mutually acceptable statements defined with those organizations. Avron, representing LETSI, commented that it may be premature to answer some issues given the current set of flux in the activities of the mentioned organizations.
------------------------------------------------------------------------------------------------------
Minutes: January 7 WG11 telecon
Approval Agenda/Minutes last meeting
- ADL, AICC, IEEE LTSC, LETSI updates- Discussion: data model revision plan and comment solicitation
- Discussion: ad hoc group for WG11 Policies and Procedures
- Discussion: ad hoc group to clarify intellectual property issues/options
Attending
Avron Barr
Ed Cohen
Don Holmes
Scott Lewis
David Mallette
Frank Polster
Tyde Richards (convener)
Schawn Thropp
Kent Weeks
Crispin Weston
- Approved: Agenda with Web site review, change of topic order. Minutes last meeting.
- ADL, AICC, IEEE LTSC, LETSI updates
Ed confirmed an AICC/ADL dialog this month to discuss common data model requirements
Kent offered to act as a liaison to ADL to get more information on their Future Learning Experience Project (aka Tin Can).
Avron reported that LETSI will be changing its status from an IEEE ISTO program to an independent non-profit organization.
Crispin reported on SALTIS developments related to implementing the recommendations of the BECTA project.
- Web site review
Schawn reviewed the plone-based IEEE LTSC Website. The information on WG11 is badly out of date. The Web site needs to be revised to reflect current activities and support the data model revision. The convener will assess the site this week. Site access requires an account. In the near future Schawn will post an email invitation to the WG reflector.
- Discussion: ad hoc group for WG11 Policies and Procedures
WG11 needs to adopt policies and procedures. The IEEE produces a template for use by all WGs. In the IEEE LTSC, WG13 has modified the template for consideration by all IEEE LTSC WGs. WG11 may want some additional changes for issues such as an adoption officer or more specialized forms of liaisons. The IEEE template and WG13 documents were briefly reviewed. All WG participants are encouraged to read these documents and send comments to the convener. WG11 will decided on WG policies and procedures by early February.
- Discussion: ad hoc group to clarify intellectual property issues/optionsa mechanism to clarify relationships.
Open issues remain concerning the use of IEEE intellectual property in implementation guides such as SCORM. The preferred outcome is for that use to be free. An ongoing dialog on that topic is continuing between representatives of the the AICC, ADL, IEEE LTSC, IEEE SA and LETSI. WG members who wish to assist with that dialog should contact the convener.
- Discussion: data model revision plan and comment solicitation
The overarching WG goal is to complete the data model revision in 2011. The initial plan is to complete broad-based comment solicitation by the March timeframe, complete a balloting draft by June, and allocate the remainder of the year to balloting and ballot comment resolution.
The WG reviewed a document containing the DM changes requested thus far and a synopsis of the relevant parts of the DM standard. This material may serve as a first iteration of a document to support more broad-based comment solicitation.
An immediate goals is to confirm ADL, AICC, and LETSI requirements and adoption plans.
Assuming the WG intends broad-based adoption, additional input is needed from geographies (e.g. Asia), learning market segments (e.g. K12) and commercial adaptors (i.e. representing emerging technologies). The proposed strategy is to identify appropriate experts and solicit their input. A couple have already been contacted in the area of international adoption.
Crispin commented that from the SALTIS perspective (UK K12) many aspects of the DM are not relevant and the important (new) feature will be an extension mechanism.
------------------------------------------------------------------------------------------------------
Minutes: December 17 WG11 telecon
- Approval Agenda/Minutes last meeting- ADL, AICC, IEEE LTSC, LETSI updates
- WG11 Issues
-- WG Officer Election/Results
-- 1484.11.3 Re-affirmation Ballot Results
-- PAR Approval for 1484.11.1 data model revision
-- Debrief Second IP telecon and Suggestions
-- Some “Getting Started” Issues
Attending
Avron Barr
Tiajuana Benson-Bond
Don Holmes
Scott Lewis
David Mallette
Frank Polster
Tyde Richards (convener)
Paul Schneider
Schawn Thropp
Guy Tourigny
Crispin Weston
- Approved: Agenda. Minutes last meeting.
- ADL, AICC, IEEE LTSC, LETSI updates
The AICC may be holding at meeting at the ADL Co-lab in January
- WG11 Issues
-- WG Officer Election/Results
Don Holmes, the "election processor", presented the results of the WG11 officer election:
Tyde Richards - Chair
Schawn Thropp - Vice Chair
Scott Lewis - Secretary
The WG discussed creating a new officer position for an adoption officer with Paul Schneider as the initial officer. The chair will clarify the procedures for setting establishing new officer roles.
-- 1484.11.3 Re-affirmation Ballot Results
The 1484.11.3 Re-affirmation ballot concluded with 100% approval and one comment from a "yes" vote that needs to be responded to. The chair requested permission to resolve the comment. The standard (XML binding of the CMI data model) is on track for a 5 year re-affirmation.
-- PAR Approval for 1484.11.1 data model revision
The IEEE SA approved the Project Authorization Request (PAR) for the 1484.11.1 data model revision. The PAR scope and purpose wording are the same as the original version of the standard, which referenced AICC CMI and not SCORM.
-- Debrief Second IP telecon and Suggestions
In early December there was a telecon to discuss 1484.11 intellectual property with participation by the IEEE SA, IEEE LTSC, ADL, AICC, LETSI. The participants confirmed that it is ok to charge for standards and that the real concern is the use of standards in implementation guides. The IEEE SA confirmed that they expect to get revenue for documents like SCORM, which historically has been distributed free. The matter was not resolved. Much of of the telecon was effectively a briefing for the IEEE SA on the complex relationship between the mentioned organizations. There were two recommendations. First, clarify the division of labor between the mentioned organizations . Second, consider the IEEE Industry Connections program as a mechanism to clarify relationships.
-- Some “Getting Started” Issues
We discussed a need to clarify working group policies and procedures, a skeletal plan for completing the data model revision in 2011, and the desirability of identifying special advisors to the WG for issues such as international adoption and accessibility support.
Minutes: December 3 WG11 telecon
- Approval Agenda/Minutes last meeting
- ADL, AICC, IEEE LTSC, LETSI updates
- WG11 Officer nominations and elections
- Discussion: review list of proposed data model changes
- Discussion: interest/feasibility of a LETSI implementation testbed
Attending
Avron Barr
Orlando Castillo
Ethan Estes
Don Holmes
Scott Lewis
David Mallette
Frank Polster
Tyde Richards (convener)
Paul Schneider
Schawn Thropp
Guy Tourigny
- Approved: Agenda. Minutes last meeting.
- ADL, AICC, IEEE LTSC, LETSI updates
Several parties who attended IITSEC reported on ADL announcements related SCORM 2004, SCORM 1.2 functionality, and an experience api project. We will need to get official ADL positions on these topics in a future WG telecon.
An AICC announcement was reported on their CMI 5.0 initiative. The relationship of CMI 5.0 to the WG11 data model revision remains a topic of interest.
The re-affirmation ballot is open for the IEEE 1484.11.3 XML binding of the CMI data model. Parties who signed up for the balloting group (now closed) are encouraged to vote.
The IEEE NesCom committee requested changes to the Project Authorization Requests (PAR) for the 1484.11.1 data model revision. The submitted wording focused too much on the revision. The suggestion was made, and followed, to use the scope and purpose wording from the PAR for the original version of the standard. This wording can accommodate proposed changes.
The second telecon to discuss IEEE LTSC IP will occur on December 9. Expected attendees include representatives from the IEEE SA, IEEE LTSC, ADL, AICC, and LETSI. The first telecon resolved that parties do not care about having to pay for the standards. What they do care about is the ability to use material from the standards in implementation guides which to date have been free. The IEEE normally charges for using standards in implementation guides but thus far has not for IEEE LTSC standards.
WG11 need to identify customers for the 1484.11.1 data model revision. Candidates include ADL, the AICC, and LETSI. A verbal report from IITSEC suggests that ADL will be a customer. This needs to be confirmed. Recommend that WG11 and supporting candidates put out a public "intent to adopt" statement in January.
- WG11 Officer nominations and elections
Don Holmes reported the officer nominations for chair, vice chair, and secretary. All nominees were present on the call. Nomination was accepted for the following positions:
Chair: Tyde Richards
Vice Chair: Paul Schneider, Schawn Thropp
Secretary: Scott Lewis
Several parties could not attend the telecon due to the IITSEC conference. The officer election was deferred/extended to an email ballot. Don Holmes, the election processor, will send out the ballot to the WG reflector. It will contain the list of eligible voters. Votes should be sent to Don before the December 17 telecon. The results will be announced in the December 17 telecon.
- Discussion: review list of proposed data model changes
Thus far, the WG has reviewed the following requested changes for the 1484.11.1 data model revision and has agreed to address them in the first revision draft.
Add identifer comments_from_learner, lms (LETSI)
Add attempt number and data element for content to interactions (LETSI)
Add completion_threshold, scaled_passing_score,weight to objectives (ADL)
Add attempt_number (ADL, LETSI)
Add learner_role (ADL)
Add extension mechanism (ADL) (SIFA solution available)
- Discussion: interest/feasibility of a LETSI implementation testbed
Briefly discussed. Deferred due to lack of time.
------------------------------------------------------------------------------------------------------
Minutes: November 19 CMI Harmonization Meeting
- Approval Agenda/Minutes last meeting
- ADL, AICC, IEEE LTSC, LETSI updates
- AICC CMI Core presentation/discussion
- Discussion: transition to IEEE LTSC wiki
Attending
Avron Barr
Tiajuana Benson-Bond
Orlando Castillo
Ed Cohen
Ethan Estes
Scott Lewis
David Mallette
Bill McDonald
Aaron Perrin
Frank Polster
Tyde Richards (convener)
Paul Schneider
Schawn Thropp
Guy Tourigny
Kent Weeks
Crispin Weston
- Approved: Agenda. Minutes last meeting.
- ADL, AICC, IEEE LTSC, LETSI updates
The re-affirmation ballot is currently open for the 1484.11.3 XML binding of CMI data model. Please vote if you are an IEEE SA member and signed up for the balloting group.
ADL is undertaking some new activities and may be prepared to brief WG11 before the end of the year.
- AICC CMI Core presentation/discussion
Ed Cohen gave a presentation on the initial AICC plans for CMI 5.0. He described a significantly new application model. The implications for WG11 need further discussion. It is not yet clear if CMI 5.0 will support the 1484.11.1 data model revision. CMI 5.0 does anticipate adding a structured extension mechanism, which appears virtually identical to SIFA extension mechanism that SIFA has made available to WG11 for consideration in the data model revision.
- Discussion: transition to IEEE LTSC wiki
Deferred to a future meeting.
