Blog

Can a Customer Survey Be Used as Part of PMCF?

July 30, 2021

Can a Customer Survey Be Used as Part of PMCF?

 

PMCF may not need to be full-blown prospective clinical investigation.  Specifically, I would place such goals under the banner of the general types of non-investigational PMCF that I’ve mentioned before in my prior PMCF post(s).  Indeed, such feedback could certainly be obtained via methods like surveys that are less rigorous than a full-blown prospective clinical investigation.

 

A few more words regarding surveys:  When comparing a non-PMCF survey to a survey that is PMCF, a key difference is the basic purpose and level of rigor in how the survey data are gathered and used.  In other words, if the survey is being done because the subject device warrants PMCF (see the aforementioned PMCF trigger criteria), then the scientific methods and rigor of EU MDR Annex XIV Part B sections 6.1 and 6.2 apply.  But if instead the survey is being gathered as non-PMCF PMS (like when the subject device doesn’t warrant PMCF), then the organization’s planning for, and analysis/use of, such PMS data may be less formal than the scientific method prescribed by Annex XIV.

FDA’s 21 CFR §820.72 Metrology Requirements vs. Test Method / Process Validation

July 29, 2021

FDA’s 21 CFR §820.72 Metrology Requirements vs. Test Method / Process Validation

 

My experience has been that FDA views a test method as a process that produces an output.  And if such output can’t be fully verified, then it must be validated.  Since FDA’s 21 CFR §820.72 is not generally related to “validation” (a very specialized, very robust, very deliberate term defined by §820.3), I’ve seen FDA handle process validation (be it for a production process yielding a tangible physical output or for a test method producing a data output) via §820.75.  For example, in a February 19, 2002 Warning Letter, FDA states, “…[we]…collected information that revealed serious regulatory problems…as follows:…Failure to validate with a high degree of assurance a process that cannot be fully verified by subsequent inspection and test as required by 21 CFR 820.75(a). For example:…The testing procedure used for…has not been validated…”

 

I would be very hesitant to try and integrate the principles of “validation” into my instrument metrology program.  That’s not something I’ve seen before in the many metrology programs I’ve encountered.  FDA and its explanations of §820.72 are generally aimed at assuring metrological adequacy of instruments rather than the adequacy of test/measurement processes.

 

Another way to put my experience is that §820.72 is related to the principles embodied by ISO 10012 / EN ISO 10012 clause 7.1 (metrological confirmation, i.e., “calibration”), whereas “validation” is instead related to the principles embodied by that standard’s clause 7.2 (measurement process development and validation).  Those sections provide a nice distinction between instrument metrology vs. measurement process (e.g., test method) validation.  They show that clause 7.1 (and I would say §820.72) is to ensure that metrological instruments are fit for their intended use, whereas 7.2 (and I would say §820.75) ensure that a process (e.g., a measurement process, i.e., a test method) is fit for the process’s intended use.

 

Because of these principles, my experience is that FDA generally associates test method validation with §820.75 rather than §820.72.  As mentioned above, I’ve seen FDA issue test method validation audit citations against §820.75 rather than §820.72.  So it seems that FDA definitely demands that we perform test method validation pursuant to §820.75 rather than §820.72.  If we applied the principles of §820.72 for test method validation, then I would get ready for a real wallop from FDA and other regulators like ISO auditors.

EU MDR PMCF: To Waive or Not to Waive

July 29, 2021

EU MDR PMCF: To Waive or Not to Waive

 

When is PMCF Required?

 

When is PMCF Required?  Do “PMCF” if, after proper premarket clinical evaluation, there remains residual risks and/or uncertainty about long-term clinical performance that may impact the benefit/risk ratio. If PMCF is indicated, then be sure the PMCF Plan contains the various design elements prescribed by EU MDR Annex XIV Part B sections 6.1 and 6.2.  Be sure to understand that per EU MDR Annex XIV.6.2(b) and Article 74, the terms “PMCF Study” and “PMCF Investigation” appear to be interchangeable, and mean a specific type of PMCF, namely, a prospective or retrospective post-market clinical investigation.  PMCF “Studies” / “Investigations” need to ensure the high quality of the collected clinical data by following principles of scientific rigor, accuracy, legibility, and completeness.  Refer to MEDDEV 2.12/2 and MDCG 2020-7 for further guidance about those most rigorous types of PMCF.  In contrast, understand also that the term “PMCF” is a general umbrella term for all types of PMCF, thus encompassing clinical investigations (a.k.a., PMCF “Studies”/”Investigations”) as well as other general types of PMCF (such as PMCF based on literature, reactive PMS data, etc.) that aren’t prospective clinical investigations.

 

The Myth that the EU MDR Doesn’t Allow Waiver of PMCF:

 

There’s a common myth that the EU MDR doesn’t allow waiver of PMCF.  In truth, we can waive PMCF if the long-term safety and clinical performance are already known from previous use of the device, or where other appropriate post-market surveillance activities would provide sufficient data to address the risks. Prepare a PMCF waiver stating the basis for the decision to waive PMCF and setting a schedule for periodic reconsideration of the waiver.  I still rely on MEDDEV 2.12/2 for further guidance about PMCF waiver.

 

I would beware of PMS / PMCF systems, assertions, training, or other paradigms that universally demand PMCF for all cases. Such an approach is not in alignment with the EU MDR, and is certain to unnecessarily escalate the cost, complexity, and burden of that aspect of a company’s EU MDR objectives.

 

To begin with, be sure not to discount that there is longstanding European historical framework and precedent for waiver of PMCF [see MEDDEV 2.12/2 (for the MDD)].  Indeed, I’ve successfully leveraged such waivers repeatedly with NBs under the MDD without objection.

 

Fast forwarding to the EU MDR era, you may remember my prior Forum explanations of how the EU MDR considers PMCF to be part of PMS.  As covered in my prior Forum posts on the topic and in my white paper “Navigating PMCF and its Mysterious Relationship to PMS and Clinical Evaluation in EU Regulation 2017/745” (email [email protected] for a copy), PMS is always required by the EU MDR, but not PMCF.  Indeed, the EU MDR’s mandatory PMS plan requirements in Annex III.1.1(b) final indent require that the PMS plan contain a PMCF plan as referred to in Part B of Annex XIV, or a justification as to why a PMCF is not applicable.  This has been echoed by the MDCG in 2020-7 which provides for a manufacturer’s “…justification in relation to non-performance of PMCF…“.

 

The option for PMCF waiver is clearly and repeatedly stated by the EU MDR, such as:

 

  • Annex II.6.1(d) and Annex III.1.1(b) (applicable to all devices)

  • Annex IX.2.1 eighth and ninth indents (available as an option for Annex IX devices, which, by the way, could encompass devices all the way up through class III)].

  • Annex VII.4.5.5 directing Notified Bodies (NB) to make way for PMCF waivers during conformity assessments.

  • Annex VII.4.6 directing NBs to consider the adequacy of the manufacturer’s PMS plan including a review of the need (or lack thereof) for a PMCF plan.

  • In addition is the provision for possible exemption from the need for any clinical data at all(yes you heard me right) in Article 61.10 (born from the same provision in MDD Annex X) which seems by default to, in such cases, waive the need for PMCF. (I actually had a prominent NB once encourage me to pursue that route instead of doing a clinical evaluation based on clinical data!).

 

Time and again under the EU MDR I’ve continued proving the integrity of these assertions via successful EU MDR third-party conformity assessments of Technical Documentation using PMCF waivers.  So, based on historical MDD conventions along with their reiteration in specific MDR provisions, it seems that the EU MDR clearly intends to maintain the longstanding precedent of permitting PMCF waiver. This is quite sensible in light of the aforesaid unique purpose of PMCF.  Indeed, deploying such a rigorous form of PMS is clearly unnecessary for realizing overall PMS goals for devices where other less-rigorous forms of proactive and reactive PMS would sufficiently guard public health.  I expand further on this topic in my aforesaid white paper.

FDA MDUFMA Small Business Determination (SBD) at the Pre-Revenue Stage

July 27, 2021

FDA MDUFMA Small Business Determination (SBD) at the Pre-Revenue Stage

 

Before addressing FDA’s MDUFMA fees and SBD program for a firm’s premarket submission when at a pre-revenue / premarket stage, my suggestion is to first remember that if a product clearance or approval [510(k) clearance, PMA approval, etc.] hasn’t happened yet, and assuming that the Sponsor is not engaged in other activities triggering the FDA establishment registration requirement, then the Sponsor should be sure it hasn’t unnecessarily registered its establishment.  This is because FDA instructs establishments not to register at the pre-approval stage.  Avoiding unnecessary establishment registration will save $5,546 / year (in today’s MDUFMA dollars) which could really add up to a lot of savings given that product development and FDA market authorization campaigns can often be multi-year efforts.

 

Regarding a firm’s lack of having yet submitted its first Federal U.S. income tax return, remember that section 738(d)(2)(B)(iii) of the Act is, as far as I know, still in effect and includes a bridging provision for firms that haven’t yet submitted their first Federal income tax return.  That provision says that, in the case of an applicant that has not previously submitted a Federal income tax return, then the applicant and each of its affiliates shall instead demonstrate the “small business” evidence via submission of a signed certification in the English language from the national taxing authority of the country in which the applicant or, if applicable, affiliate is headquartered, certifying that the applicant or affiliate meets the criteria for a “small business”.  Firms need to be sure to give due consideration to this bridging provision when at a pre-revenue / pre-taxation stage.

 

However, the Act’s section 738(d)(2)(B)(iii) bridging provision may not need to be used at all even though seemingly so at first glance.  Indeed, many corporations must submit periodic Federal income tax returns (e.g., Form 941 QUARTERLY Federal Tax Return) during the year leading up to the annual tax return.  Such periodic returns are in fact official Federal income tax returns.  Accordingly, leveraging such periodic Federal tax returns may also be a viable strategy, specifically, by submitting some or all of the year’s periodic Federal income tax returns in order to officially and statutorily demonstrate that year’s current Federal income status.  Some discussion with the Agency may be needed for that strategy in order to determine if the Agency interprets the Act’s phrase “most recent Federal income tax return for a taxable year” to only mean an annual tax return, or if that could also be interpreted to mean the current year’s Federal income tax returns to date.  If needed, I wouldn’t hesitate to assert with the Agency that a compilation of the year’s periodic Federal income tax returns would meet the statutory criterion “most recent Federal income tax return for a taxable year” called for by the Act.  And it seems that FDA would be amenable to that in light of its webpage guidance stating that if the firm has been in business for less than a year, it can provide the FDA with a copy its U.S. income tax return for a period of time that’s less than 1 year.  FDA says that the dates encompassed by the partial-year return need to be identified on the tax return.  For that scenario, FDA also asks that the firm provide documentation (such as Articles of Incorporation) identifying the business’s formation date in order to further justify the lack of a full year’s tax return.  FDA also says the firm may submit a personal income tax return if needed, where the personal return must identify the submitter’s business and gross receipts or sales under Schedule C of the Form 1040.

 

Finally, don’t forget that there is a one-time waiver of the MDUFMA PMA fee for a Sponsor’s inaugural PMA pursuant to section 738(d)(1) of the Act.

EU MDR Strategy for Configurable Software

July 22, 2021

EU MDR Strategy for Configurable Software

 

For my clients that manufacture software-only medical devices, I have sought and implemented what I feel is the ideal:  The software design and architecture are such that there is one executable software file, but that can be configured via licensing to turn various modules on or off.  In this approach, all modules are always present in the software, yet not always turned on.  For the purposes of EU MDR conformity, this means there is one product, and thus one DoC, one NB certificate, and one technical documentation file.  The different licensing configurations are handled in the software and technical documentation via software installation controls.  This approach avoids the hassle of applying the EU MDR’s requirements for “accessories” (i.e., medical devices in their own right), such as the typical need for accessories to have dedicated (usually separate) technical documentation, labeling, DoCs, and/or NB certificates.

 

Noteworthy parts of the EU MDR’s definition [see Article 2(2)] for “accessory” are that a) it’s an article which intrinsically is not itself a medical device [i.e., it’s just a widget that doesn’t intrinsically meet the EU MDR definition in Article 2(1)]; and b) the main software medical device can’t function as intended (i.e., as labeled, advertised, etc.) without the “add-on”.  If the “add-on” doesn’t meet these criteria, then it’s not an “accessory”.  Instead, it would either be part of the main medical device software or else a separate medical device in its own right providing supplemental features/functionality or else or else a non-medical (e.g., an EU MDR preface item 19 general purpose, life-style, well-being, etc.) device all together.  In the approach I’ve modeled above in my first paragraph, all of the software modules and corresponding code, whether turned on or off, are still part of the same software medical device and executable file.

 

If on the other hand the “add-ons” are a) actually add-ons in the truest sense, meaning that they are separated software files/patches/code; and either b1) they actually meet the formal definition of “accessory” [meaning that they don’t intrinsically meet the definition of medical device yet enable the main software medical device to function as intended (rather than just providing supplemental features/functionality)], or b2) they just provide supplemental medical device features/functionality, then the manufacturer would typically be stuck handling such add-ons as “accessories” (i.e., as devices in their own right) or as separate medical devices altogether, where dedicated (typically separate) technical documentation, labeling, DoC, certificates, etc., would be required.

EU MDR Changes to MDD DoC under EU MDR Article 120

July 22, 2021

EU MDR Changes to MDD DoC under EU MDR Article 120

 

When considering the requirements for revising an MDD (or EU MDR) Declaration of Conformity (DoC) associated with device changes (whether significant or nonsignificant), it’s important to know that there must always be a valid DoC that accurately represents required details about the subject device’s current state of conformity.  Indeed, under the MDD (by way of the EN ISO/IEC 17050 series) and the EU MDR alike, manufacturers are required to continuously update the DoC to assure it remains accurate.

 

Accordingly, if any change is made to an MDD-certified device to be placed on the market after 26 May 2021 [the EU MDR Date of Application (DoA)] under EU MDR Article 120’s transitional provisions, then the subject device’s Declaration of Conformity (DoC) must be revised as needed if the nature of the change impacts the accuracy of the original declaration.

 

As we all know, the MDD and EU MDR both generally require that the Notified Body (NB) be informed about significant changes as part of updating the DoC and technical documentation.  But if the change truly is nonsignificant, then the MDD and EU MDR permit the DoC and technical documentation to be updated without notification to the Notified Body (NB).  That said, be sure to carefully review the NB contract, as some NBs may nonetheless demand to be somehow informed even for nonsignificant changes.

 

Examples of changes that would directly affect the accuracy (and thus require revision) of the DoC include but are not limited to address changes, standard edition changes, part numbers obsoleted, part numbers changed, and others.  Some of these might turn out to be either significant or nonsignificant depending on the associated particulars.  So “be sure you’re sure” about whether the change is significant or nonsignificant.

 

Regarding the clerical aspect (e.g., the form or format) of the revised DoC, it’s noteworthy that the EN ISO/IEC 17050 series has traditionally and normatively given manufacturers the liberty to decide what format suits them best even though it informatively offers an example format.  The EU MDR has not withdrawn such liberty.  Accordingly, to assure DoC accuracy, it seems that manufacturers could either append an amendment (e.g., via memo) pursuant to EN ISO/IEC 17050-1 clause 6.2 or EU MDR Annex IV.9, or else create a new DoC altogether.  I prefer the latter, as the memo-approach seems clunky and ripe for errors and omissions.  Either way, be sure that the expiry date of the DoC remains in alignment with Article 120’s cut-off dates if such changes are made for the context of EU MDR Article 120 transitional provisions.

ISO 13485 QMS Planning vs. Quality Plans

July 19, 2021

ISO 13485 QMS Planning vs. Quality Plans

 

I think it’s important to remember that the general quality management system planning and set-up called for by ISO 13485 clause 5.4.2(a) is fundamentally distinct from clause 7.1’s product/project/object/output-oriented planning.  If they were the same, then ISO TC/210 would not have separated and distinguished clauses 5.4.2(a) and 7.1.

 

Clause 5.4.2(a) general quality management system planning is aimed at the more fundamental quality management system setup, implementation, and maintenance of clause 4.1.  By contrast, ISO TC/210 has traditionally maintained and currently maintains that a clause 7.1 “quality plan” is instead a product/project/object/output-oriented plan generated to support product realization.  Indeed, the scope and intent of ISO 10005 correlates with clause 7.1 quality plans (i.e., product realization plan, i.e., Widget XYZ realization plan, etc.) rather than clause 5.4.2(a) general quality management system planning.

 

While an ISO 13485 clause 7.1 / ISO 10005 quality plan may indeed address the need for particular quality management system features specific to the object/output of the quality plan, it is nonetheless important that a clause 7.1 quality plan not be confused or equated with clause 5.4.2(a) general quality system planning.

 

Another way to explain it is that the organization might have multiple clause 7.1 / ISO 10005 quality plans addressing the product realization requirements for various tangible Widgets, projects, or other product realization outputs, whereas clause 5.4.2(a) quality management system planning is a singular (yet ongoing) planning process.

 

I simply handle ISO 13485:2016 clause 5.4.2(a) by stating in the Quality Manual that:

 

  1. The organization has determined the processes needed for the quality management system and the application of these processes throughout the organization taking into account the roles undertaken by the organization. [Remember that those roles need to first be specified in an appropriate section of the Quality Manual.]

  2. This also includes planning the sequence and interaction of the QMS processes via the Quality Manual and the documented procedures included or referenced therein.

  3. Moreover, the organization applies a risk-based approach to the control of the appropriate processes needed for the quality management system as described in the corresponding subsection of the Quality Manual (e.g., see ‘Risk-based approach’ under ‘Scope’).

  4. The ultimate output of this planning is the Quality Manual and the procedures included or referenced therein.

Risks from an Inadequate Development Process for Software

July 19, 2021

Risks from an Inadequate Development Process for Software

The most fundamental reason for medical device design and development controls (e.g., ISO 13485 clause 7.3; the U.S. FDA’s 21 CFR 820.30, etc.) is to control risks that come from an inadequate development process.  That fact is unequivocally true and stands in stark contrast to the erroneous notion that there are no risks from the software development process.  For example, in a 6-year study, FDA found that approximately 44 percent of medical device quality problems leading to recalls were attributed to design errors that FDA says may have been prevented by adequate design controls.  And regarding design and development of software, FDA did a subsequent study for fiscal year (FY) 1983 through FY 1991 and found that a whopping 90 percent of all software-related device failures were from failure to have a proper software development process.

 

When approaching risk management regarding the software development process itself (as distinguished from risk management of the software medical device), the general paradigm needs to start from a process-focused approach rather than a device-focused starting point.

 

There are multiple ways to do process-focused risk analysis.  Now, we all know how important it is to realize that FMEA, on its own, is not sufficient to meet ISO 14971’s risk management and analysis requirements.  But for temporary discussion purposes, I’m going to dare say something slightly to the contrary in order to help drive home the process-focused concept mentioned above.  Specifically, to really grasp the distinction of the process-focused concept, think in terms of p(process) FMEA vs. d(design) FMEA.  Okay, there I said it.  Now quickly, while my colleagues (and me too of course) are catching their breath and settling down about the mention of FMEA in the context of risk management, I’ll reiterate the disclaimer that we need to be sure and remember FMEA’s intrinsic limitations and intent.

 

So, if you’re familiar with doing risk analysis for a process (instead of a device), then those principles are the ones that should be applied in order to do risk management of the software development process itself.  What can be confusing is that the ultimate purpose of medical device risk management is to control the risks to patients and users.  Consequently, it may well be (as the U.S. FDA has indicated), that an inadequate development process can indeed be ultimately correlated to patient and user harms.  But there may also be process-centric hazards and harms (derived e.g., via FMEA) that are focused on the process itself.  When that is the case, then bridge the ISO 14971 risk management gap by being sure to, where appropriate, ultimately extrapolate (by representation as resulting hazardous situations and sequences of events) into the patient or user harms.

 

Check out AAMI TIR 36 (Annex B ‘Severity’ explanation under ‘Risk management terminology as it applies to quality and production systems) and ISO 80002-2 (Annex B section B.4) for interesting interpretations of how process risk analysis can differ from product risk analysis. In addition, IEC 60812 also contains some good basic process FMEA insights which can reasonably be adapted for software development process risk analysis.

 

(Note that it’s only by mere coincidence that AAMI TIR 36 and ISO 80002-2 which I cited happen to involve a software-related context; please note that they aren’t intended to address medical device software validation, nor device software development.  Instead, I recommended these resources simply because they coincidentally happen to provide some good illustrations about doing process-focused risk analysis as distinguished from device-focused disk analysis.)

FDA Remote Regulatory Assessment

July 16, 2021

FDA Remote Regulatory Assessment

 

For the U.S. medical device jurisdiction, a client and I a couple weeks ago went through an FDA Remote Regulatory Assessment (RRA).  Here’s a recap:

 

FDA contacted the firm and informed them that, due to the current SARS-CoV-2 (COVID-19) situation, the FDA is conducting inspections [called Remote Regulatory Assessment (RRA)] on a limited basis at this time.  FDA said they were offering the RRAs to firms based on risk, meaning that high-risk firms (e.g., high risk class, poor past inspection results, etc.) would not generally be eligible for the RRA process.  FDA proposed a date for conducting the RRA.  FDA explained that an RRA is a review of records and information provided by the inspected firm to gain information and to evaluate the firm’s Quality System.  The RRA was conducted by a Consumer Safety Officer.

 

FDA states that the RRA is a voluntary activity that will not result in regulatory action due to non-participation.  RRAs may be limited in scope or terminated at the discretion of the Agency. The RRA is limited to reviewing information that can be provided electronically.  FDA says that the firm’s ability to do so should factor into its decision for participation.

 

Refusal to provide information during the RRA is not a refusal under FDA’s inspection authority found in Section 704 of the Act (21 USC 374).  Similarly, FDA does not present a Form FDA 482 at the beginning of the RRA, nor does FDA issue a Form FDA 483 at the end even if objectionable conditions are discovered during the RRA. At the conclusion of the RRA, a discussion of findings is held with management officials describing any items FDA wants to bring to the firm’s attention.

 

Here comes the caveat:  Based on the outcome of findings from the RRA, FDA may consider “further communication and/or action”. If significant deficiencies are noted, FDA may begin an onsite regulatory inspection for the purpose of protecting public health.  If that’s necessary, then the designated management official will be notified.

 

We found the RRA to be very informal and pleasant (just short of a trip to the dentist), where information was exchanged merely via telephone, email, and via Zoom online meetings. There was no virtual walk-around of the facility.  When all was said and done, three partial days (few hours per day) was spent in the assessment.

 

Finally, the best news of all:  FDA said that the RRA would satisfy the statutory inspectional requirement, thus resetting the firm’s cycle/queue for inspection assignments made via FDA’s inspection scheduling system (e.g., in FACTS).

 

Send us an email for an example of the information boilerplate that FDA disseminates when it initiates an RRA.

Showing Conformity to Standards

July 16, 2021

Showing Conformity to Standards

 

Regardless of the source of a request for evidence showing conformity with applicable standards, a pivotal underlying fundamental remains the same and drives the answer:  Conformance with standards is generally a design/development verification and/or validation activity.  Therefore, the general rule of thumb is that there needs to be a verification and/or validation protocol (explaining, among other things, how the verification/validation will be done), and a report to document the results and conclusions.  Stick to the principles embodied for example in ISO 13485 clauses 7.3.6 and 7.3.7 and you should be on track.  Failure to do this regarding conformity with applicable standards can lead to compliance (and maybe even safety) problems.

 

It has been said that design verification may involve inspections, tests, examination, demonstration, or other analyses.  And although various verification methods may be employed, any verification approach which establishes conformance with a design input requirement is an acceptable means of verifying the design with respect to that requirement.  Sometimes we must get creative for this (e.g., via basic visual inspections, document/content review/confirmations, etc.) when the nature of the verification doesn’t warrant actual testing.

 

Here are some design validation principles I’ve collected from various resources to help determine what may be appropriate validation techniques for a given scenario:  Design validation follows successful verification and may occur in stages. Certain aspects of design validation can be accomplished during the design verification, but design verification is not a substitute for design validation.  State targeted user needs / intended uses in objective, measurable terms, including acceptance criteria.  Specify the collection of discrete, quantified results that can be objectively measured.  Assure that validation studies include actual or simulated use of the product.  Specify defined operating conditions (i.e., temperature, humidity, shock and vibration, corrosive atmospheres, etc.) where appropriate. Include statistically meaningful sample sizes that are justified.  Validation studies must be performed on initial / pilot production units or their equivalents.