Designing Learning for Educational Excellence (DLE2) or the Designing Learning Model - FAQs
about_LBD expectation assessment collaboration results updates

About DLE2 (or DL) Model

  1. What is the "DLE2 (or DL) Model or LBD Model"?
  2. How is the DLE2 (or DL) Model different from what I already do in my classroom?
  3. What is the difference between the DLE2 (or DL) Model, 7-Step Model, Embodied Theory and Higher-Level Literacy Skills?
  4. What are Higher-Level Literacy Skills?
  5. How are teachers assigned to quadrants in the 2x2 factorial design?
  6. Student attitudes towards learning in our classrooms are important to our success in the DLE2 (or DL) project. How do we assess the “affective” components of learning in our class next year?
 
Top
1.

What is the "DLE2 (or DL) Model"?
The "DLE2 (or DL) Model" stands for Designing Learning for Educational Excellence or simply Designing Learning Model, an evidence-based instructional intervention in which students and teachers become co-creators of knowledge (2007). The “Design” in the DLE2 (or DL) Model underscores the intentionality for promoting learning and increasing student achievement throughout the intervention. Specifically, the Designing Learning Model has two components.

First, it utilizes an Embodied Theory (aka the 7-step model) for curriculum planning and delivery. Second it promotes higher-level thinking and conceptual understanding by explicitly using Higher-Level Literacy Skills (HLS) to actively promote the teaching for transfer–when students use their learning and understanding from one subject and apply it in other subject areas and real-life situations.

By focusing on the five HLS–critical thinking, problem solving, mathematical reasoning, inference making and visualization/modeling–we can meet the needs of this cognitively sophisticated, technology-savvy generation. This will also help move these learners away from gaining mere “inert” knowledge as Prof. Brent Wilson discussed during DLE2 (or DL) Model, Session 3 Training.

These two components–embodied theory and higher-level literacy skills–together will help us explicitly focus on our overall project goals of equity and excellence at Overland to close both the achievement gap (equity) and raise the academic achievement of all students (excellence).

Go Back
2.

How is the DLE2 (or DL) Model different from what I already do in my classroom?
The DLE2 (or DL) Model incorporates what teachers have been trained to do well in their classrooms–teaching. However, the main focus on the DLE2 (or DL) Model is using the Embodied Theory (aka 7-step model) and Higher-Level Literacy Skills (Refer Question 1) to increase student thinking, learning and achievement.

 
Go Back
3.

What is the difference between the DLE2 (or DL) Model, 7-Step Model, Embodied Theory and Higher-Level Literacy Skills?
The Designing Learning model has two components. First, it utilizes an Embodied Theory (aka the 7-step model) for curriculum planning and delivery. Second it promotes higher-level thinking and conceptual understanding by explicitly using Higher-Level Literacy Skills (HLS) to actively promote the teaching for transfer. By focusing on the five HLS–critical thinking, problem solving, mathematical reasoning, inference making and visualization/modeling–more learners will move away from gaining mere “inert” knowledge to use their learning and understanding from one subject and apply it in other subject areas and real-life situations. These two components together will help us explicitly focus on both equity and excellence at Overland to close the achievement gap (equity) and raise the academic achievement of all students (excellence).

 
Go Back
4.

What are Higher-Level Literacy Skills?
Higher-Level Literacy Skills (HLS) are five higher-level thinking skills that the DLE2 (or DL) Model focuses on. These five skills are beyond what is typically considered traditional “literacy” skills (i.e., reading, writing and numeracy – Recall last paragraph on p. 4 of Chapter 1 in How People Learn and Prof. Brent Wilson’s discussion during Session 3 DLE2 (or DL) Model Training). The Higher-Level Literacy Skills (HLS) actively promote conceptual understanding and the teaching for transfer. The five HLS–critical thinking, problem solving, mathematical reasoning, inference making and visualization/modeling–will help more learners will move away from gaining mere “inert” knowledge and instead use their learning and understanding from one subject and apply it in other subject areas and real-life situations.

 
Go Back
5.

How are teachers assigned to quadrants in the 2x2 factorial design? Teachers have been randomly assigned, by computer, to a quadrant in the 2x2 factorial experimental design. The first quadrant is already available on Communication > Group Pages on the DLE2 (or DL) Model Virtual PLC in BlackBoard.

 
Go Back
6.

Student attitudes towards learning in our classrooms are important to our success in the DLE2 (or DL) Model. How we assess the “affective” components of learning in our class next year?
The counseling department has this charge. They will be administering an informal survey of our students every 3 weeks. This survey should take no more than 5 minutes to complete and will not always occur in your particular class.

Go Back

Expectations

  1. What are the dates, times, expectations and commitments of this project?
2. What is actually due July 1?
3. Which of our classes will we be required to implement the DLE2 (or DL) Model in?
4. Why is it important to keep track of my hours on the Time and Effort Record Sheet?
5. What happens if I cannot meet one of the requirements in the initial DLE2 (or DL) Model contract I signed?
6. When do we get our stipends?
7. How will I be held accountable to show I have met the requirements of the DLE2 (or DL) Model contract?
8. Can I skew my testing data by how I administer my tests?
 
Top
1.

What are the dates, times, expectations and commitments of this project?
Beginning summer 2007, teachers participating in the project will begin their training on the DLE2 (or DL) Model. Teachers involved in the project are required to attend two, two-hour training sessions and one full-day training session to learn the DLE2 (or DL) Model. Additionally, teachers are required to attend two full-day of training sessions on assessment, Overland Unit Planner, and technology tools to support the DLE2 (or DL) Model. Teachers are required to turn in their “Curriculum Plans” to the Principal, Jana Frieler, by July 1, 2007 for the first quarter of their instruction in Fall 2007.

There are four components to the “Curriculum Plan:” (1) Units planned using the Overland Unit Planner (see sample) for Quadrant 2 (EE) in the DLE2 (or DL) Model, (2) Pre-Observation Form for each Unit in the first quarter, (3) Course Shell for BlackBoard, so the Site Leadership can enroll as students and comment on the Course and (4) the First Semester Final for their 2007 course. Additional deadlines will be announced for the other academic quarters, depending on project funding.

Go Back
2.

What is actually due July 1?
Teachers are required to turn in their “Curriculum Plans” to the Principal, Jana Frieler, by July 1, 2007 for the first quarter of their instruction in Fall 2007. There are four components to the “Curriculum Plan:” (1) Units planned using the Overland Unit Planner for Quadrant 2 (EE) in the DLE2 (or DL) Model (see sample), (2) Pre-Observation Form for each Unit in first quarter, (3) Course Shell for BlackBoard, so the Site Leadership can enroll as students and comment on the Course and (4) the First Semester Final for their 2007 course. Additional deadlines will be announced for the other academic quarters, depending on project funding.

Go Back
3.

Which of our classes will we be required to implement the DLE2 (or DL) Model in?
Teachers will be required to implement the DLE2 (or DL) Model in all sections of one subject they will be teaching next year. However, because of random assignments into the 2x2 factorial experimental design, teachers may have their classes in different experiment quadrants (e.g., EE, EN, or TE), with the understanding, that they will be assigned to no more than two of the three experimental quadrants. You will see during the Unit Planner training, how easy it is to modify and adapt an EE lesson to the EN and TE quadrants. Adjusting and adapting an EE lesson plan to fit an EN or TE quadrant is minimal.

Go Back
4.

Why is it important to keep track of my hours on the Time and Effort Record Sheet?
Accountability is very important! All persons involved with the project must document ALL of their work for the project so that the can be properly compensated for their efforts. Failure to properly document time and effort will limit compensation a participant receives.

Go Back
5.

What happens if I cannot meet one of the requirements in the initial DLE2 (or DL) Model contract I signed?
Participants in the project must meet all requirement set forth in the initial DLE2 (or DL) Model contract. If a participant cannot complete any aspect of the contract they forfeit their compensation.

Go Back
6.

When do we get our stipends?
Stipend requests for the initial DLE2 (or DL) Model training will be submitted to HR July 26 for all teachers that meet the requirements per DLE2 (or DL) Model Agreement I. Teachers should receive this payment in their August 2007 paychecks.

Go Back
7.

How will I be held accountable to show I have met the requirements of the DLE2 (or DL) Model contract?
Teachers will be monitored to ensure they have completed all requirements of the DLE2 (or DL) Model contract. Submitted Curriculum Plans will be reviewed by the Site Leadership Team to ensure that they meet the requirements of the project. Additionally, each teachers will be observed four times in action by Jana Frieler and/or Shannon Minch using the three-minute classroom walk-through observation-protocol to determine how effectively and purposefully students are learning in the classroom.

 
Go Back
8.

Can I skew my testing data by how I administer my tests?
YES! It is important that all teachers administer their pre and post-test in the exact same fashion. The importance of this becomes clear when you imagine two teachers administering the same pretest. Teacher A says something like, “Please hurry and take this pretest, we all know you don’t know much about the topic yet, so just bubble as quickly as possible so we can move on.” In contrast, Teacher B explains, “Today you will take a pretest on _______. Please take your time and do your best work because I will use this pretest data to "help guide our learning through this unit"/"see how well you can read/write/reason mathematically/understand science concepts." Normalized gains for the pre and post-tests could be affected if there is a difference in how a teacher administers these unit tests.

 
Go Back

Assessment

  1. Are other teachers required to administer the assessments I make for my DLE2 (or DL) Model classes?
2. If there is another teacher involved in the project teaching the same course as I, do we have to have common assessment for the final and each unit even though we may be in different quadrants of the 2x2 factorial design?
  3. What are the makes up a good “pre-write” assessment?
  4. Should my pre-write and post-write for a particular unit be identical?
  5. Will we need to include the ICAS assessment frameworks (& ASSESS) in our lesson planning in addition to the state standards and district GVCs?
  6. What is the value in pre-testing before each unit?
 
1.

Are other teachers required to administer the assessments I make for my DLE2 (or DL) Model classes?
During the first semester of the 2007-2008 school year, teachers teaching freshman courses that are not directly participating in the project, may, but will not be required to administer the assessments generated by the DLE2 (or DL) Model participants (FYI: School PLTs will be developing common final assessment for each semester next year). Your PLT may choose to adopt your final as the course final, but it is not required. If your school PLT chooses to construct a new final for semester one, you will still need to give the final you developed this summer even though other teachers in your PLT might be giving a different common final. Regardless, the TN teachers (teachers not participating in the project) will be required to administer the ICAS or ASSESS test at the beginning and end of the school year next year if the project is funded.

 
Go Back
2.

If there is another teacher involved in the project teaching the same course as I, do we have to have common assessment for the final and each unit even though we may be in different quadrants of the 2x2 factorial design?
Yes. Teachers involved with the project teaching the same courses must all have common assessments. This requirement is critical because it is an important data point for formative assessment for the DLE2 (or DL) Model by the Site Leadership Team. Additionally, common assessments are one way the best practices within this building will be identified and recognized.

Go Back
3.

What makes up a good “pre-write” assessment?
Following our reading of chapter 1 in How People Learn (HPL), the pre-writes are critical in eliciting learners' preconceptions and rudimentary understanding of concepts. A well-written pre-write will elicit student misconceptions and naive renditions of their conceptual understanding to inform our instruction.

Go Back
4.

Should my pre-write and post-write for a particular unit be identical?
No, they should not be because we cannot then generalize about the transfer and connections made by our learners.

Go Back
5.

Will we need to include the ICAS assessment frameworks (or ASSESS) in our lesson planning in addition to the state standards and district GVCs?
Yes. Incorporation of the ICAS assessment frameworks is important so that we can continuously use them to guide our lesson development. Since these tests have an emphasis on Higher-Level Literacy Skills, using their assessment frameworks in lesson development will help us focus on this important component in the DLE2 (or DL) Model.

At any rate, the grade level assessment frameworks of Grade 9 CSAP Reading, Writing, Mathematics, and Science should be the most important document guiding your classroom instruction.

Go Back
6.

What is the value in pre-testing before each unit?
There are two reasons for pretesting our students:
First, as we have seen in chapter one of How People Learn, pre-testing (especially our pre-writing component of the Embodied Theory) helps elicit incomplete understandings, false beliefs and naïve renditions of concepts that students bring with them to our subject-disciplines (Recall Fish-is-Fish story). The research shows that if the above are not brought to the surface, students may develop understandings that are very different from the teacher’s intent and/or they may learn the information for the purposes of a test, but they may revert to their old preconceptions (Fish-is-Fish) later. As we continue through the HPL book we will learn more about this important component in the DLE2 (or DL) Model.
Second, data that is collected from our unit tests will be reported out as “normalized gains” which can only be calculated if a pretest is given. The value of reporting out data using normalized gains is that it controls for differences in the abilities of the diverse groups of students we have in our classes. Look at the chart below for an example of student performance on a unit test between two teachers:

Teacher

Pretest Average

Post-test Average

Normalized Gain

N.G. expressed in %

A

48%

66%

.35

35%

B

60%

70%

.25

25%

In the example above, if Teacher A’s students received a 66% post-test average and Teacher B’s students received a 70% post-test average, it would initially seem that Teacher B’s students outperformed Teacher A’s students. It might seem that Teacher B should be sharing “best practices” with Teacher A. However, if the pretests were 48% and 60% for Teacher A’s and B’s students respectively, when the normalized gains between the teachers is calculated they would be .35 and .25 (35%, 25% normalized gains) for Teachers A and B respectively. That means that Teacher A’s students increased .1 (10%) more than Teacher B’s students from their starting point at the beginning of the unit and the best practices conversation may need to go in another direction. A normalized gain effectively controls for differences in background knowledge for diverse groups of students and allows us to compare the relative gain of each group of students. Normalized gains will also be calculated for the CSAP, ICAS and ASSESS between the different groups of the 2x2 factorial experimental design. See summary student results from Nathan Balasubramanian's Physics classes in 2007-2008 here.

Go Back

Collaboration

  1. Can teachers plan and work together?
2. What is the level of collaboration required in this project?
 
Top
1.

Can teachers plan and work together?
Yes. However, teachers may not use the, “divide and conquer” approach. Curriculum and assessments must be developed collaboratively to be acceptable.

Go Back
2.

What is the level of collaboration required in this project?
It is expected that teachers involved in the project will attend weekly PLC meetings after school with the teachers in their subject area and monthly meetings involving all project participants. Collaboration across subject-disciplines for Unit/Lesson development is encouraged, but is not absolutely required.

Go Back

Results

  1. Do we know if the faculty development training on the "DLE2 (or DL) Model" worked?
  2. How can we tell if the Site Leadership Team graded our "Unit Planners" reliably?
 
Top
1. Do we know if the faculty development training on the "DLE2 (or DL) Model" worked?
Good question, considering the "DLE2 (or DL) Model" is an evidence-based instructional model. Here are the summary results of our 9-hour DLE2 (or DL) Model training for the first cohort of teachers (the Blazing "early adopters"). We will do similar analyses with data from our individual classes to understand how the different sub-groups of students achieve when compared across the different treatment groups.
 
DLE2 (or DL) Model_summary_results
N
13
Pretest Mean (%)
47.0 ± 3.4
Pretest SD (%)
12.1
Post-test Mean (%)
73.1 ± 1.9
Post-test SD (%)
6.8
t-value
10.711
p-value
<.oo1
Normalized gain
49%
Effect size (Cohen's d)
2.659
Effect size (Pearson's r)
0.799
  These results are impressive, despite the small sample size. First, these gains are statistically significant (at the established 0.05 level) and p < .001 means that there is less than .1% probability that the observed differences happened by chance. Second, the number after ± in the pretest and post-test mean scores is the error, the standard error of the mean–the standard deviation of the distribution of the mean of the samples. Third, the normalized gain of .49 means that even though teachers had no time to prepare for their post-test and took their post-test on the last Saturday before school closed for summer, they gained almost 50% knowledge just by attending the 9-hour training and participating in the embedded reflections. Fourth, the large value (2.7 standard deviations from the mean) of Cohen's d implies that the mean of the post-test scores is at the 99th percentile of the pretest scores. Additionally, the Pearson's r correlation of .799 shows that 89% of the variance in the post-test scores can be accounted for (with coefficient of determination r2) due to the DLE2 (or DL) Model training. At any rate, our "gold standard" of success will continue to remain student learning and achievement as assessed by teachers, Administrators, and the Site Leadership Team.
 
Go Back
2. How can we tell if the Site Leadership Team graded our "Unit Planners" accurately (reliably)?
 
First Draft Unit Planner Scores
First Cohort
Mean = 82.6%
Cronbach's Alpha
α = 0.9752
Grader
N
Mean
(%)
SD
(%)
1
13
86.3
8.3
2
13
81.8
9.6
3
13
81.2
8.5
4
13
80.9
8.6
  After extensive face-to-face deliberations on July 7, the Site Leadership Team used the rubric that we shared with the teachers during the June 11 training (see sample), to individually and independently grade the unit planners that the teachers had submitted. Our Cronbach's Alpha was 0.9752, a very large value. Cronbach's alpha is an estimate of grader consistency, and a value of 1.0000 would have meant there was no measurement error because there was perfect agreement (reliability) between the graders.
 
Go Back

Updates

  1. What are we going to do if the project were not funded by the US DoE?
  2. When are we going to get feedback on our Unit Planners?
 
Top
1. What are we going to do if the project were not funded by the US DoE?
  The leadership cadre of teachers will start the school year as if the project were funded and fulfill the expectations of weekly PLTs and monthly PLC's. The Principal and Assistant Principal(s) will be doing their 3-minute classroom walk-through's to assess student engagement and learning. At the end of the quarter, if the Site Leadership Team see outcomes of effective student learning, we will find alternate funding to support teachers' continued use of the DLE2 (or DL) Model.
 
Go Back
2. When are we going to get feedback on our Unit Planners?
  During the week of August 13, we will have a brief meeting to give you general feedback on your Unit Planners and what you need to get them resubmitted before they are finally uploaded onto BlackBoard website as exemplars for the different subject-disciplines.
 
Go Back

Valid XHTML 1.0 Transitional    Valid CSS!