NuttX-7.21 ---------- The 121st release of NuttX, Version 7.21, was made on June 6, 2017, and is available for download from the Bitbucket.org website. Note that release consists of two tarballs: nuttx-7.21.tar.gz and apps-7.21.tar.gz. These are available from: https://bitbucket.org/nuttx/nuttx/downloads https://bitbucket.org/nuttx/apps/downloads Both may be needed (see the top-level nuttx/README.txt file for build information). Additional new features and extended functionality: * Core OS: - pthread rwlocks: Add an implementation for read/write locks (rwlocks) into the pthread library. These locks are writer priority, such that if any writers come in they are given priority for writing. From Mark Schulte. - pthread robust mutexes: Implement robust mutex support: pthread_mutex_lock() and trylock() will return EOWNERDEAD if the mutex is locked by a thread that no longer exists. Add pthread_mutex_consistent() to recover from this situation. Keep list of all mutexes held by a thread in a list in the pthread's TCB. When pthread exits or is cancelled, mutexes held by thread are marked inconsistent and the highest priority thread waiting for the mutex is awakened. There is a configuration option to (a) support only robust mutexes, (b) support only traditional unsafe mutexes, or (c) Support both unsafe and robust mutexes via pthread_mutexattr_get/setrobust(). - pthread cancellation points: Add logic to disable cancellation points within the OS. This is useful when an internal OS function that is NOT a cancellation point calls an OS function which is a cancellation point. In that case, irrecoverable states may occur if the cancellation is within the OS. From Juha Niskanen. - clock: Add clock_resynchronize and use subseconds RTC. Add clock_resynchronize for better synchronization of CLOCK_REALTIME and CLOCK_MONOTONIC to match RTC after resume from low-power state. Add up_rtc_getdatetime_with_subseconds under CONFIG_ARCH_HAVE_RTC_SUBSECONDS to allow initializing (and resynchronizing) system clock with subseconds accuracy RTC. From Jussi Kivilinna. - clock: Add new type ssystime_t for relative 64-bit ticks, change ticks<->time conversion functions to use ssystime_t. From Jussi Kivilinna. - clock: Add testing for 32-bit overflow of 64-bit system timer. From Jussi Kivilinna. * File Systems/Block and MTD Drivers - drivers/mtd/w25.c: Erase sector only if it is not in erased state. From Jussi Kivilinna. * Graphics/Display Drivers: - drivers/lcd: Extend st7565 driver to include support for the AQM_1248A. From Masayuki Ishikawa. - drivers/lcd: Add driver for Nokia 5110 (Philips PCD8544). From Alan Carvalho de Assis. * Networking/Network Drivers: - Extensive modifications to support wireless network (see below). - TUN driver: Implement TAP (OSI layer 2) mode. Enable by setting the IFF_TAP flag instead of the IFF_TUN flag in ifr_flags. From Thomas Keh. - Add user-space networking stack API (usrsock). User-space networking stack API allows user-space daemon to provide TCP/IP stack implementation for NuttX network. Main use for this is to allow use and seamless integration of HW-provided TCP/IP stacks to NuttX. For example, user-space daemon can translate /dev/usrsock API requests to HW TCP/IP API requests while rest of the user-space can access standard socket API, with socket descriptors that can be used with NuttX system calls. From Jussi Kivilinna. - net/: Network driver now retains Ethernet MAC address in a union so that other link layer addresses may be used in a MULTILINK environment. * Wireless Networking/Wireless Drivers: - BCM43362: Support for Broadcom's BCM43362 WiFi chip was contributed by Simon Piriou as part of the port of the Particle Photon board. Only station functionality is available at present. This work includes not on the WiFi driver, but the support Particle Photon board, the infrasture for IEEE 802.11 FullMAC networking including the network device interface, WiFi configuration, AP scanning and authentication and association with an AP. - IEEE 802.11 networking tools and support. - IEEE 802.15.4 MAC support. This is an effort that was started some time back by Sebastien Lorquet (with some help from Matte Poppe). Recently, Anthony Merlino has taken on this effort and has made some significant progress. Using the Microchip MRF24J40 module with the Mikroe Clicker2-STM32 board along with a PC-based IEEE 802.15.4 sniffer, Anthonly has verified correct transmission and receipt of basic frames. - Microchip MRF24J40: As mentioned above, this IEEE 802.15.4 radio driver is now basically functional. - IEEE 802.15.4 Network Driver: A driver that interfaces the NuttX network with the IEEE 802.15.4 MAC has been developed but is still incomplete and has not been verified. - IEEE 802.15.4 Network Loopback Driver: A simple IEEE 802.15.4 MAC loopback driver was developed. This driver allowed for parallel development of the IEEE 802.15.4 MAC and 6LoWPAN. - 6LoWPAN: The Contiki 6LoWPAN stack has been ported so that works within the NuttX networking framework and interfaces with the new IEEE 802.15.4 MAC via the network driver. Live testing with IEEE 802.15.4 radios has not yet been done; all testing has used the loopback driver. There are no known problems and the stack is ready for additional testing. - Add option to enable wireless debug output. * Other Common Device Drivers: - Add entropy pool and strong random number generator. Entropy pool gathers environmental noise from device drivers, user-space, etc., and returns good random numbers, suitable for cryptographic use. Based on entropy pool design from *BSDs and uses BLAKE2Xs algorithm for CSPRNG output. Patch also adds /dev/urandom support for using entropy pool RNG and new 'getrandom' system call for getting randomness without file-descriptor usage (thus avoiding file- descriptor exhaustion attacks). The 'getrandom' interface is similar as 'getentropy' and 'getrandom' available on OpenBSD and Linux respectively. From Jussi Kivilinna. - XBox One controller: Adds USB host driver support for the XBox One controller. Currently only the latest version (XBox One X) controller works. The older XBox One controllers do not enumerate correctly. From Brian Webb. - drivers/analog: Add basic COMP driver. From Mateusz Szafoni. - drivers/analog: Add driver for the LTC1767L ADC. From Martin Lederhilger. - drivers/analog: Add basic OPAMP driver. From Mateusz Szafoni. - drivers/sensors: Add driver for ST HTS221 humidity sensor. From Juha Niskanen. - drivers/sensors: Add driver for ST LPS25H pressure sensor. From Juha Niskanen. - drivers/sensors: Add driver for ST LIS2DH accelerometer. From Timo Voutilainen. - drivers/usbmisc: Add driver for Fairchild FUSB301 USB type-C controller. From Harri Luhtala. - RTC: Add interface for check if RTC time has been set. New interface allows checking if RTC time has been set. This allows to application to detect if RTC has valid time (after reset) or should application attempt to get real time by other means (for example, by launching ntpclient or GPS). From Jussi Kivilinna. - Buttons: Change return value of board_buttons() and the type of btn_buttonset_t to uint32_t so that more than 8 buttons can be supported. - drivers/syslog: Use monotonic clock for timestamp when available. From Jussi Kivilinna. - SPI: Add an instance argument to the SPIDEV definitions. Thus, instead of specifying a FLASH device, for example, as SPI_FLASH, you would now use SPI_FLASH(0) where the "instance" argument now distinguishes multiple FLASH devices on the same SPI bus. From Sebastien Lorquet. - IOBs: Move from net/iob to a better location in mm/iob where they can be shared outside of the networking logic. Current also used by IEEE 802.15.4 MAC and by syslog (when buffering enabled). - syslog: Add option to buffer SYSLOG output to avoid interleaving. Uses new shareable IOBs. Additional logic to assure that the the write from the buffer is a single atomic write in normal debug output. - drivers/can: Move CAN subsystem to its own directory and put device drivers there. From Alan Carvalho de Assis. - drivers/can: Add Microchip MCP2515 CAN Bus controller driver. From Alan Carvalho de Assis. - drivers/audio: Add cs43l22 audio driver. From Taras Drozdovsky. - drivers/input: Add Cypress MBR3108 CapSense touch button driver. From Juha Niskanen. * Simulation - configs/sim/sixlowpan: Configuration for testing the 6LoWPAN with the IEEE 802.15.4 loopback network driver. * Infineon XMC4xxx: - arch/arm/src/xmc4: Initial, partial support for Infineon XMC4xxx. * Infineon XMC4xxx Boards: - XMC4500 Relax: Add basic board support infrastructure of Infineon XMC4500 Relax Lite v1. Basic serial, LED, and button button support for a simple NSH configuration. There are still stome remaining issues with serial communications. * MicroChip PIC32MX Boards: - pic32mx7mmb: Add support for the Pinquino toolchain. - pic32mx7mmb: Add support for PROCFS file system. * NXP Freescale Kinetis: - Kinetis: Allow board to add pullups on SDHC lines. From David Sidrane. - Kinetis: Use optional BOARD_OSC_CR and BOARD_OSC_DIV in clock configuration. From David Sidrane. * NXP Freescale Kinetis Drivers: - Kinetis: Add Timer PWM Module (TPM) to K66 chip. From David Sidrane. - Kinetis: Added HW flow control and termios. From David Sidrane. - Kinetis: Add ARCH_HAVE_I2CRESET. From David Sidrane. * NXP Freescale LPC43xx: - Add support for LPC4337FET256. From Andreas Bihlmaier. * STMicro STM32: - Change STM32 tickless to use only one timer. From Konstantin Berezenko. - STM32 F7: Add support for LSE RTC and enable RTC subseconds. From Jussi Kivilinna. - STM32 L1: stm32l15xx_rcc: Add support for using MSI as system clock. From Juha Niskanen. - STM32 L1: stm32l15xxx_rcc: configure medium performance voltage range and zero wait-state when allowed by SYSCLK setting. Zero wait-state for flash can be configured when: (1) Range 1 and SYSCLK <= 16 MHz, (2) Range 2 and SYSCLK <= 8 MHz, or (3) Range 3 and SYSCLK <= 4.2 MHz. Medium performance voltage range (1.5V) can be configured when SYSCLK is up to 16 MHz and PLLVCO up to 48 MHz. From Juha Niskanen. - STM32 F0: Add basic support for STM32F0. From Alan Carvalho de Assis. - STM32 F0: Add basic support for STM32F07x family. - STM32 L1: stm32l15xx_rcc: Allow board to configure HSE clock in bypass-mode. Allows using MCO output from ST-link chip (on Nucleo and Discovery boards) as HSE input. From Juha Niskanen. - STM32 L1: Add support for STM32L152CC, STM32L152RC and STM32L152VC. From Juha Niskanen. - STM32 F0: Add support for HSI48. - STM32 L4: Add support for the STM32L496XX family. From Juha Niskanen. - STM32 L4: modularize Kconfig to support different product lines/families. This is modeled after STM32F7. Idea is to declare each chip in Kconfig but allow for flash size override. Commit adds many STM32L4_HAVE_XXX feature test macros. From Juha Niskanen. - STM32 L4: Separate SYSCFG into product line specific files for clarity. From Juha Niskanen. - STM32 L4: Add support for many new MCUs from the STM32L4X3XX product line. From Juha Niskanen. - STM32 L4: Add dbgmcu header files. From Juha Niskanen. - STM32 F410: Add support for STM32F410. STM32F410 is a version of STM32F4 with 32 KB of RAM and 62 or 128 KB of flash. From Gwenhael Goavec-Merou. * STMicro STM32 Drivers: - SDIO: Extensions to support the SDIO interface to the BCM43362 from Simon Piriou. - STM32 F2: Add USB OTG HS support for stm32f20xxx cores. From Simon Piriou. - STM32 F2, F4, and F7: Add BOARD_DISABLE_USBOTG_HSULPI flag. From Simon Piriou. - STM32 F33: Move DMA logic to a separate files + add ADC support. From Mateusz Szafoni. - STM32 F3: Add COMP support. From Mateusz Szafoni. - STM32 F33: Support for COMP character driver. From Mateusz Szafoni. - STM32 F4: Implement DMA support for the STM32F4 I2C. From Rajan Gill. - STM32 F7: Add stm32 RNG support. This is copied from stm32l4. Tested on STM32F746ZG board. From Juha Niskanen. - STM32 L1: Add STM32L162VE to chip.h. From Juha Niskanen. - STM32 F4: Add I2C3 SDA pin mapping for STM32F411. From no1wudi. - STM32 L1: stm32_flash: Add EEPROM writing for STM32L15XX. From Juha Niskanen. - STM32 F7: Serial: Add interface to get uart_dev_t by USART number, stm32_serial_get_uart. From Jussi Kivilinna. - STM32 F4: Provide TIM5 definition for STM32F429. From Matias v01d. - STM32 F0: Add an untested port of the F1 USB device to the STM32F0. - STM32 F0: Add support for the STM32F09X family. From Juha Niskanen. - STM32 F0: Initial cut at I2C driver. Still a work in progress. From Alan Carvalho de Assis. - STM32 F33: Add OPAMP support. From Mateusz Szafoni. - STM32 L4: stm32l4_i2c: Add I2C4 code. From Juha Niskanen. - STM32 L4: Add GPIO_PORTI definition. From Juha Niskanen. - STM32 F7 Serial: Allow configuring Rx DMA buffer size. From Jussi Kivilinna. - STM32 L4: Firewall for stm32l4x3xx. Not tested for any product family, but now it at least compiles. L496 devices can have one bit wider Volatile Data Segment. From Juha Niskanen. - STM32 TIM: Add method to get timer width. Freerun timer: Use timer width to get the correct clock rollover point. - STM32 L4: Add internal flash write support. From Juha Niskanen. - STM32 L4: Port stm32l4_serial_get_uart function from STM32F7. From Juha Niskanen. - STM32 Ethernet: Add support for KSZ8081 PHY interrupts. From Sebastien Lorquet. - STM32 F4: Add I2S driver. From Taras Drozdovsky. - STM32 L4: Add IWDG peripheral. This is the same as for STM32 except that prescale and reload can be changed after watchdog has been started, as this seems to work on L4. From Juha Niskanen. - STM32 F7: Add SPI DMA support. From Jussi Kivilinna. * STMicro STM32 Boards: - Support for the Particle Photon board was contributed by Simon Piriou. The Photon board is based on a STM32F205G MCU with and on- board BCM43362 WiFi chip that interfaces via the STM32's SDIO interface. Board configuration support includes, in addition, buttons, LEDS, IWDG, USB OTG HS, and procfs support. Configurations available for nsh, usbnsh, and wlan configurations. - Clicker2-STM32: Support for the Mikroelektronika Clicker 2 for STM32 was added by Anthony Merlino. This board, along with the MRF24J40 Click board is the platform used to deveop the IEEE 802.15.4 support. The boad configuration includes the MRF24J40 initialization logic and SPI support. Configurations exist for nsh, knsh, usbnsh, and mrf24j40-radio. - Nucleo_F334R8: Add ADC example. From Mateusz Szafoni. - Nucleo-F334R8: Add COMP support. From Mateusz Szafoni. - Nucleo-F334R8: Use new COMP driver. From Mateusz Szafoni. - Adds USB host support to stm32f411-disco board. From Brian Webb. - Add stm32f0discovery board support. From Alan Carvalho de Assis. - Nucleo-F072RB: Add board configuration. - Nucleo-F334R8: Add OPAMP support. From Mateusz Szafoni. - Nucleo-F072RB: Add support for the I2C driver used by I2C tools. - Nucleo-L496ZG: Add nucleo-l496zg board files. From Juha Niskanen. - Nucleo-F091RC: Add nucleo-f091rc board files. From Juha Niskanen. - Nucleo-L432KC: Add nucleo-l432kc board files. From Sebastien Lorquet. - Nucleo-L452RE: Add nucleo-l452re board files. From Juha Niskanen. - stm32f103-miniumum: Add board support to use the Nokia 5110 LCD display driver. From Alan Carvalho de Assis. * C Library/Header Files: - C library: Add strerror_r(). - C Library: Add wcstoull(), swprintf(), wcstod(), wcstof(), wcstol(), wcstold(), wcstoul(), wcstoll() functions. Add mbsnrtowcs() and wcsnrtombs() (just returning success). Add mbtowc() and wctomb() to C++ std namespace. From Alan Carvalho de Assis. - C Library: Add ffsl(), ffsll(), fls(), flsl(), flsll() and use GCC's __builtin_ctz/__builtin_clz for faster implementation of these. From Jussi Kivilinna. - fixedmath: Add square root and b32_t conversion operators. From Jussi Kivilinna. - locale.h: Add a bogus definition of locale_t. - C library: Versions mbrlen and mbsrtowcs taken and adapted from FreeBSD code (at https://github.com/freebsd/freebsd/). From Matias v01d. * Build/Configuration System: - Include C++ library in 'make export'. From Alan Carvalho de Assis. - configs: Remove all setenv.sh and setenv.bat files. Remove all references to setenv.sh and setenv.bat from all config README files. - Kconfig/deconfigs: Add CONFIG_ARCH_TOOLCHAIN_GNU to indicate that the toolchain is based on GNU gcc/as/ld. This is in addition to the CPU-specific versions of the same definition. - Move prototype for up_cxxinitialize() from nuttx/include/nuttx/arch.h to apps/include/platform/cxxinitialize.h. * Tools: - Add initialconfig.c so that perhaps in the future we will be able to use this to generate a new configuration from scratch (rather than having to derive new configurations from existing configurations). NOTE: Not yet intregated into the build system. * NSH: apps/nshlib: - Added support for set [{+|-}{e|x|xe|ex}] [ ]. Set the 'exit on error control' and/or 'print a trace' of commands when parsing scripts in NSH. The settings are in effect from the point of execution, until they are changed again, or in the case of the init script, the settings are returned to the default settings when it exits. Included child scripts will run with the parents settings and changes made in the child script will effect the parent on return. Use 'set -e' to enable and 'set +e' to disable (ignore) the exit condition on commands. The default is -e. Errors cause script to exit. Use 'set -x' to enable and 'set +x' to disable (silence) printing a trace of the script commands as they are ececuted. The default is +x. No printing of a trace of script commands as they are executed. From David Sidrane. - Print expanded variables if -x. From David Sidrane. - ifconfig command: Extend ifconfig to support 6LoWPAN. Adapt to some changes in configuration variable usage. - Network initialization: If IEEE802.11 selected use wlan0 instead of eth0 for network device name. - Network initialization: NSH now has configuration options to select the wireless properties. It builds the configuration structure and passes this to wpa_driver_wext_associate() so that it will set the network as configured. - Network initialization: Add a new option CONFIG_NSH_NETLOCAL that will suppress some built in operations and will support manual configuration of a wireless network through command line tools. * Examples/Tests: apps/examples: - examples/xbc_text: Adds a test program for the XBox One controller driver. From Brian Webb. - examples/ostest: Add a test of robust mutexes. - examples/ostest: Add tests for pthread_rwlock. Adding tests to be used to verify the pthread_rwlock lock works. From Mark Schulte. - examples/ostest: Additional test for rwlock and one for cancel cleanup handlers. From Juha Niskanen. - examples/usrsocktest: Add application for USRSOCK testing. From Jussi Kivilinna. - examples/nettest: Adapt for use in testing 6LoWPAN. - examples/nettest: If doing loopback, but not using the official loopback device, then use the server should use the configured client IP address. - examples/udpblaster: Several fixes to work with 6LoWPAN. - examples/udpblaster: Add logic to bind the local UDP socket to a well-known address. - examples/configdata: Add stacksize and priority. From Juha Niskanen. * Network Utilities: apps/netutils: - netutils/netlib: Add IEEE 802.11 wireless IOCTL wrappers. - netutils/netlib: Add a helper function to convert a string to a 6LoWPAN node address. - netlib and NSH: Add logic to get/set the IEEE802.15.4 PAN ID. - netutils/dhcpc: Make the network device name a configuration option. Was hardcoded to eth0 but may, instead, need to be wlan0. - netutils/dhcpc: Remove hard-coded interface device. Now passed as a parameter to dhcpc_open(). From Sebastien Lorquet. * Wireless Utilities: apps/wireless: - wireless/wapi: Port of Wapi wireless services. The original depended on features not supported by NuttX: Removed logic that depends on Linux netlink. Removed functionality that depended on the Linux procfs: This includes only 1) listing of available interfaces and 2) listing of all routes. - wireless/wapi: Create command line Wapi application based on Wapi sample code. - wireless/wapi: wpa_driver_wext_associate() now accepts a configuration parameter that can be used to specify the wireless properties. - wireless/wapi: Add basic wapi_event_stream_extract implementation. From Simon Piriou. - wireless/ieee802154: Add iwpan and i8sak tools. iwpan is similar in concept to wapi. From Anthony Merlino (i8sak was originally by Sebastien Lorquet). - wireless/ieee802154/libmac: IEEE 802.15.4 MAC library. - wireless/wext: Add drivers_wext from the WPA supplicant; Integrate into NSH. From Simon Piriou. * System Utilities (apps/system) - apps/system/dhcpc: Add a command to renew or establish a lease on an IPv4 address. - apps/system/ntpc: Add a command to start or stop the NTPC daemon. - apps/system/ramtest: Make stacksize and priority conigurable. * Platform-Specific Support (apps/platform) - apps/platform: Create gnu/ subdirectory that contains the one and only GNU C++ initialization function. Remove all other C++ initialization functions. Bugfixes. Only the most critical bugfixes are listed here (see the ChangeLog for the complete list of bugfixes and for additional, more detailed bugfix information): * Core OS: - Priority inheritance: When CONFIG_SEM_PREALLOCHOLDERS==0, there is only a single, hard-allocated holder structure. This is problem because in sem_wait() the holder is released, but needs to remain in the holder container until sem_restorebaseprio() is called. The call to sem_restorebaseprio() must be one of the last things the sem_wait() does because it can cause the task to be suspended. If in sem_wait(), a new task gets the semaphore count then it will fail to allocate the holder and will not participate in priority inheritance. This fix is to add two hard-allocated holders in the sem_t structure: One of the old holder and one for the new holder. - Priority inheritance: sem_holder sem_findholder missing inintalization of pholder. sem_findholder would fail and code optimization covered this up. From David Sidrane. - Partial Fix priority inheritance CONFIG_SEM_PREALLOCHOLDERS=0. From David Sidrane. - Priority inheritance: sem_boostholderprio prevent overrun of pend_reprios. The second case rtcb->sched_priority <= htcb->sched_priority did not check if there is sufficient space in the pend_reprios array. From David Sidrane. - lp_worker: Guard from pend_reprios overflow. From David Sidrane. - Priority inheritance: Fixes improper restoration of base_priority in the case of CONFIG_SEM_PREALLOCHOLDERS=0. The call to sem_restorebaseprio_task context switches in the sem_foreachholder(sem, sem_restoreholderprioB, stcb); call prior to releasing the holder. So the running task is left as a holder as is the started task. Leaving both slots filled thus failing to perform the boost/or restoration on the correct tcb. This PR fixes this by releasing the running task slot prior to reprioritization that can lead to the context switch. To faclitate this, the interface to sem_restorebaseprio needed to take the tcb from the holder prior to the holder being freed. In the failure case where sched_verifytcb fails it added the overhead of looking up the holder. There is also the additional thunking on the foreach to get from holer to holder->tcb. An alternate approach could be to leve the interface the same and allocate a holder on the stack of sem_restoreholderprioB copy the sem's holder to it, free it as is done in this pr and then pass that address sem_restoreholderprio as the holder. It could then get the holder's tcb but we would keep the same sem_findholder in sched_verifytcb. From David Sidrane. - Priority inheritance: Fixes improper restoration of base_priority. From David Sidrane. - sem_holder: Indexing error. From David Sidrane. if (sem->holder[0].htcb != NULL || sem->holder[**1**].htcb != NULL) - realloc(): When realloc() has to fall back to calling malloc(), size including overhead was being provided to malloc(), causing a slightly larger allocation than needed. Noted by initialkjc@yahoo.com. - scheduler: Fix tg_flags check with GROUP_FLAG_NOCLDWAIT. From Masayuki Ishikawa. - scheduler: Fix CHILD_FLAG_EXITED in include/nuttx/sched.h. From Masayuki Ishikawa. - binfmt/elf: Fix offset value when calling elf_read() in elf_symname(). From Masayuki Ishikawa. - binfmt/elf: Fix offset value when calling elf_read() in elf_sectname(). From Masayuki Ishikawa. - There can be a failure in IOB allocation to some asynchronous behavior caused by the use of sem_post(). Consider this scenario: (1) Task A holds an IOB. There are no further IOBs. The value of semcount is zero. Task B calls iob_alloc(). Since there are not IOBs, it calls sem_wait(). The value of semcount is now -1. (2) Task A frees the IOB. iob_free() adds the IOB to the free list and calls sem_post() this makes Task B ready to run and sets semcount to zero NOT 1. There is one IOB in the free list and semcount is zero. When Task B wakes up it would increment the sem_count back to the correct value. (3) But an interrupt or another task runs occurs before Task B executes. The interrupt or other tak takes the IOB off of the free list and decrements the semcount. But since semcount is then < 0, this causes the assertion because that is an invalid state in the interrupt handler. So I think that the root cause is that there the asynchrony between incrementing the semcount. This change separates the list of IOBs: Currently there is only a free list of IOBs. The problem, I believe, is because of asynchronies due sem_post() post cause the semcount and the list content to become out of sync. This change adds a new 'committed' list: When there is a task waiting for an IOB, it will go into the committed list rather than the free list before the semaphore is posted. On the waiting side, when awakened from the semaphore wait, it will expect to find its IOB in the committed list, rather than free list. In this way, the content of the free list and the value of the semaphore count always remain in sync. - binfmt: Fix .dtor memory allocation. From Masayuki Ishikawa. * File System/Block and MTD Drivers: - SmartFS: If whence is SEEK_END, the file offset shall be set to the size of the file plus offset. Noted by eunb.song@samsung.com. - mtd/progmem: Fix incorrect target address calculation. progmem_read/write() is incorrectly calculating the target address, expecting the offset argument is given in a block number. This is completely wrong and as a result invalid flash region is accessed. Byte-oriented read/write interfaces of mtd device accept the target address in a byte offset, not a block number. From Heesub Shin. - procfs: Fix wrong member IDs are displayed when 'cat /proc//group/status'. From Nobutaka Toyoshima. - procfs: Fix incorrect uptime with CONFIG_SYSTEM_TIME64. From Masayuki Ishikawa. - vfs/poll: round timeout up to next full tick. Calling poll() with timeout less than half tick (thus MSEC2TICK(timeout) => 0) caused returning error with EAGAIN. Instead of rounding timeout down, value should be rounded up. Open Group spec for poll says: "Implementations may place limitations on the granularity of timeout intervals. If the requested timeout interval requires a finer granularity than the implementation supports, the actual timeout interval will be rounded up to the next supported value." From Jussi Kivilinna. - mtd/config: erase block between block read and write. From Juha Niskanen. - mtd: Build RAMTRON and AT45DB drivers only if selected. From Juha Niskanen. - mtd/config: Fix byte read interface test. From Juha Niskanen. - mtd: Fix some unallocated and NULL pointer issues. rwb->wrflush and rwb->wrmaxblocks in rwbuffer could get unallocated values from ftl_initialize() in some configurations. Also fixes related assert: up_assert: Assertion failed at file:rwbuffer.c line: 643 that can happen with the following configuration: CONFIG_FTL_WRITEBUFFER=y CONFIG_DRVR_WRITEBUFFER=y # CONFIG_FS_WRITABLE is not set These problems are caused by CONFIG variable differences between the buffer layers. TODO: This is not a perfect solution. readahead support has similar issues. From Juha Niskanen. - net procfs: Fix buffer corruption and refactor netdev_statistics.c. From Masayuki Ishikawa. - FAT: Fix 'Missing unlock' in fs_fat32.c. From Masayuki Ishikawa. - VFS fdopen: Add missing file stream flags clearing. Clear file stream structure regardless of config options. Structure clearing is needed as previous use of stream list entry might leave fs_flags set. From Harri Luhtala. - mtd/smart: Fix use of uninitialized variable. From Jussi Kivilinna. - mtd/w25.c: Enable short delay after sector/chip erase. From Jussi Kivilinna. - mtd/config: Add some error checks for I/O errors. From Juha Niskanen. * Graphics/Graphic Drivers: - net procfs: Some long lines were being generated that cause buffer- related problems and corrupted output. * Networking/Network Drivers: - Fixed wrong assert on udp dgram send. From Pascal Speck. - TCP/IPv6: Fix a compile issue when IPv6, but not IPv4 is enabled. - net/socket/accept: Fix building with CONFIG_NET_LOCAL_STREAM. From Jussi Kivilinna. - Argument of network device IOCTL should be unsigned long, just as will all other IOCTL methods. - net/socket: Fix cloning of local and raw sockets. From Jussi Kivilinna. - TCP: Wait for 3-Way Handshare before accept() returns. From Simon Piriou. - TCP: Send RST if application 'unlistens()' before we complete the connection sequence. - TCP: An RST received during the 3-way handshake requires a little more clean-up. - IPv6: Fix net_ipv6_pref2mask(). From Masayuki Ishikawa. - network IOCTL commands: The only place in net/netdev/netdev_ioctl.c where the interface state should change is for SIOCSIFFLAGS. The other ones .. SIOCSIFADDR, SIOSLIFADDR, SIODIFADDR .. should not change the link state. From Sebastien Lorquet. - TCP: Fix tcp_findlistner() in dual stack mode. From Masayuki Ishikawa. * Common Drivers: - Fix as5048b by adding missing frequency parameter. From Andreas Bihlmaier. - multiple fixes in nrf24l01 driver: (1) signal POLLIN if there is already data in the FIFO, (2) send ETIMEDOUT to userspace after 2 seconds if TX IRQ was not received, (3) handle FIFO overflow, (4) handle invalid pipes/empty FIFO, and (5) multiple cosmetics (missing static, duplicate define, missing \n). From Leif Jakob. - input/mxt: Prevent overriding i2c transfer return value. put_reg/get_reg function was overriding i2c transfer error code with i2creset return value, that lead to OK status although actual transfer failed. From Juha Niskanen. - drivers/audio/wm8904: WM8904 has same problem as that fixed by Juha Niskanen in the MaxTouch driver. - UART 16550: Missing left parenthesis in function prototype. This is Bitbucket Issue #41. - USBMSC: Fix a wrong lun number issue. From Masayuki Ishikawa. - drivers/i2c: Fix compile issues if CONFIG_DISABLE_PSEUDOFS_OPERATIONS is enabled. - drivers/serial: I discovered a problem in the file drivers/serial/serial.c concerning the function uart_close. In the case that a serial device is opened with the flag O_NONBLOCK the function uart_close blocks until all data in the buffer is transmitted. The function close called on an handle opened with O_NONBLOCK should not block. The problem occurred with a CDC/ACM device. From Stefan Kolb. - drivers: Fix some bad NULL checks. From Juha Niskanen. - drivers: Rename newly introduced up_i2creset to I2C_RESET. From Juha Niskanen. - drivers/bch: BCH character driver bch_ioctl() always returns -ENOTTY for DIOC_GETPRIV command. It should returns OK if DIOC_GETPRIV command succeeds. From EunBong Song. - Replace sprintf() with snprintf() in pipe.c. From Nobutaka Toyoshima. - drivers/bch: Fix 'Missing Unlock' in bchdev_driver.c. From Masayuki Ishikawa. - button_upper: Fix interrupt enabling for poll-events. From Jussi Kivilinna. - drivers/{sensors,usbmisc}: Fix uninitialized I2C frequency. From Juha Niskanen. * ARM: - Set EABI stack alignment for all ARM architectures (remove OABI code). From David Cabecinhas. - Remove redundant interrupt stack coloring and OABI code. From David Cabecinhas. - Fix off-by-one interrupt stack allocation in 8-byte aligned architectures. From David Cabecinhas. * ARMv6-M: - CONFIG_DEBUG_HARDFAULT should be available for Cortex-M0 too. * Microchip/Atmel SAM3/4 Drivers: - SAM3/4: Fixed configurations for TWI master. Obviously an incomplete port from SAMA5. * Microchip/Atmel SAMv7 Drivers: - SAMV7: Watchdog: Fix Forbidden Window Value. According the Datasheet the WDD Value is the lower bound of a so called Forbidden Window and to disable this we have to set the WDD Value greater than or equal to the WDV Value. This seems to be a bug in the datasheet. It looks like we have to set it to a greater value than the WDV to really disable this Thing. When triggering the Watchdog faster than the (very slow) clock source of the Watchdog fires, this Forbidden Window Feature resets the System if WDD equals to WDV. This Changeset disables the Forbidden Window by setting the WDD Value to the Maximum (0xfff) Value possible. From Frank Benkert. - SAMV7 EMAC: Add conditional logic to account the fact that the SAMV71 has 6 rather than 3 queues after version 1. From Ian McAfee. * NXP/Freescale Kinetis Drivers: - Kinetis: Fixed GPIO _PIN_OUTPUT_LOWDRIVE swapped with _PIN_OUTPUT_OPENDRAIN. From David Sidrane. - Ensure interrupts are back on BEFORE running code dependent on clock_systimer. From David Sidrane. - Kinetis k66, k64, k60, k40, k20: Pin mux configure all I2C signals as Open Drain. The output structure of the GPIO for I2C needs to be open drain. When left at the default, one can observe on a scope the slave contending with the push-pull during the ACK. From David Sidrane. - Kinetis K66: Fixed TMP2_CH1 definition. From David Sidrane. - Kinetis K66: Define ALT1 to match ref manual. From David Sidrane. - Kinetis K66: GPIO and pin mux cleanup. From David Sidrane. - Kinetis ADC: Various corrections and updates. From David Sidrane. * NXP/Freescale LPC43xx: - Add missing PINCONF_INBUFFER in several places of lpc4310203050_pinconfig.h. From Andreas Bihlmaier. - Fix logic in preprocessor checks and correct arguments to lpc43_pin_config initialization. From Andreas Bihlmaier. * NXP/Freescale LPC43xx Drivers: - Fix logic error in lpc43_adc. From Andreas Bihlmaier. - Use correct macro for irqid (fortunately both point to LPC43_IRQ_EXTINT+18). From Andreas Bihlmaier. - Actually write modified value to register. From Andreas Bihlmaier. - Increase number of supported PWM channels from 4 to 6. From Andreas Bihlmaier. * Silicon Labs EFM32 Drivers: - EFM32 I2C: Fix timeout calculation. From Masayuki Ishikawa. * STMicro STM32: - As discovered by dcabecinhas. This fix assume the 8 byte alignment options for size stack size or this will overwrite the first word after TOS. See https://github.com/PX4/Firmware/issues/6613#issuecomment-285869778. From David Sidrane. - STM32 F7: In stm32_allocateheap.c There are 5 not 4 configurations. From David Sidrane. * STMicro STM32 Drivers: - STM32, STM32 F7, STM32 L4: OTG host drivers: Do not do data toggle if interrupt transfer is NAKed. Suggested by webbbn@gmail.com. - Save elapsed time before handling I2C in stm32_i2c_sem_waitstop(). This change follows the same logic as in previous fix to stm32_i2c_sem_waitdone(). It is possible that a context switch occurs after I2C registers are read but before elapsed time is saved in stm32_i2c_sem_waitstop(). It is then possible that the registers were read only once with "elapsed time" equal 0. When scheduler resumes this thread it is quite possible that now "elapsed time" will be well above timeout threshold. In that case the function returns and reports a timeout, even though the registers were not read "recently". Fix this by inverting the order of operations in the loop - save elapsed time before reading registers. This way a context switch anywhere in the loop will not cause an erroneous "timeout" error. From Freddie Chopin. - STM32, STM32 F7, and STM32 L4: Clone Freddie Chopin's I2C change to similar STM32 I2C drivers. From David Sidrane. - STM32: OTG host implementations of stm32_in_transfer() must obey the polling interval for the case of isochronous and interrupt endpoints. - STM32: Fix erase sector number for microcontrolers with more than 11 sectors. Erase a sector from the second bank cause the bit 4 of SNB being set but never unused, so trying to erase a sector from the first bank was actually eraseing a sector from the second bank. From José Roberto de Souza. - STM32: Make up_progmem thread safe. Writing to a flash sector while starting the erase of other sector have a undefined behavior so lets add a semaphore and synchronize access to Flash registers. But for the semaphore to work it needs to be initialized so each board needs call stm32_flash_initialize() on initialization, so to avoid runtime problems it is only using semaphore and making it thread safe if initialized, after all boards starts to call stm32_flash_initialize() we can remove the boolean and the check. From José Roberto de Souza. - STM32: Add workaround for flash data cache corruption on read-while-write. This is a known hardware issue on some STM32 see the errata of your model and if you make use of both memory banks you should enable it. From José Roberto de Souza. - STM32 Flash fixes. From José Roberto de Souza. - STM32 Flash: Missing unlock on F1 HSI off path. From David Sidrane. - STM32 F4 I2C: I needed to use DS3231, I remember that in past it worked ok, but now for stm32f4xx is used another driver (chip specific, stm32f40xxx_i2c.c) and DS3231 driver doesn't work. After investigating a problem I found that I2C driver (isr routine) has a few places there it sends stop bit even if not all messages are managed. So, e.g., removing stm32_i2c_sendstop (#1744) and adding stm32_i2c_sendstart after data reading helps to make DS3231 working. From Alexander Oryshchenko; verified by David Sidrane. - STM32 F7 Serial: Serial fix for dropped data: (1) Revert the inherited dma bug from the stm32. see https://bitbucket.org/nuttx/nuttx/commits/df9ae3c13fc2fff2c21ebdb098c520b11f43280d for details. And (2) Most all CR1-CR3 settings can not be configured while UE is true. Threfore we make all operation atomic and disable UE and restore it's originalstate on exit. From David Sidrane. - STM32 L1: Fix IWDG and WWDG debug mode stop for STM32L15XX. From Juha Niskanen. - STM32 F7: Fix UART7 and UART8 IFLOWCONTROL options. From Jussi Kivilinna. - STM32 F7: Add warning for RXDMA + IFLOWCONTROL combination. Combination of RXDMA + IFLOWCONTROL does not work as one might expect. Since RXDMA uses circular DMA-buffer, DMA will always keep reading new data from USART peripheral even if DMA buffer underruns. Thus this combination only does following: RTS is asserted on USART setup and deasserted on shutdown and does not perform actual RTS flow-control. Data loss can be demonstrated by doing long up_mdelay inside IRQ critical section and feeding data to RXDMA+IFLOWCONTROL UART. From Jussi Kivilinna. - STM32 F7 Serial: Do not stop processing input in SW flow-control mode. From Jussi Kivilinna. - STM32 L4 DMA: Correct bad channel definition. From Sebastien Lorquet. - STM32 F7: Warn if no DMA2 configured when using ADC with DMA. Also correct ADC channel numbers that DMA callback passes to upper half driver. From Juha Niskanen. - STM32 F7 ADC: Do not override ADCPRE_DIV when measuring internal voltage. From Juha Niskanen. - STM32 L4: Don't think these chips have DPFPU, DTCM or ITCM. From Juha Niskanen. - STM32 F7 Flash: macro naming errors, there is no FLASH_CONFIG_F for F7. From Juha Niskanen. - STM32 L4: stm32l4x6xx_pinmap: Update I2C4 and DCMI pins. From Juha Niskanen. - STM32 L4: stm32l4_i2c: change wrong macro to CONFIG_I2C_POLLED. From Juha Niskanen. - Fix STM32F7 I2C interrupt handler. From Jussi Kivilinna. - STM32: Serial Allow configuring Rx DMA buffer size. From David Sidrane. - STM32 CAN: I had the problem that the transmit FIFO size (= actual elements in FIFO) was slowly increasing over time, and was full after a few hours. The reason was that the code hit the line "canerr("ERROR: No available mailbox\n");" in stm32_cansend, so can_xmit thinks it has sent the packet to the hardware, but actually has not. Therefore the transmit interrupt never happens which would call can_txdone, and so the size of the FIFO size does not decrease. The reason why the code actually hit the mentioned line above, is because stm32can_txready uses a different (incomplete) condition than stm32can_send to determine if the mailbox can be used for sending, and thus can_xmit forwards the packet to stm32can_send. stm32can_txready considered mailboxes OK for sending if the mailbox was empty, but did not consider that mailboxes may not yet be used if the request completed bit is set - stm32can_txinterrupt has to process these mailboxes first. Note that I have also modified stm32can_txinterrupt - I removed the if condition, because the CAN controller retries to send the packet until it succeeds. Also if the condition would not evaluate to true, can_txdone would not be called and the FIFO size would not decrease also. From Lederhilger Martin. - STM32 Serial: Fix freezing serial port. Serial interrupt enable/disable functions do not disable interrupts and can freeze device when serial interrupt is received while execution is at those functions. Trivially triggered with two or more threads write to regular syslog stream and to emergency stream. In this case, freeze happens because of mismatch of priv->ie (TXEIE == 0) and actually enabled interrupts in USART registers (TXEIE == 1), which leads to unhandled TXE interrupt and causes interrupt storm for USART. From Jussi Kivilinna. - STM32 I2C: Make private symbols static. From Juha Niskanen. - STM32 L4 GPIO: Put back EXTI line source selection. From Juha Niskanen. - STM32 L4 RTC: Store RTC MAGIC to backup reg, not to address zero. From Juha Niskanen. * STMicro STM32 Boards: - Disable serial console on stm32f103-minimum usbnsh example project config. Devices enumerate after this change. From Bob Ryan. - Nucleo-144: Default for choice in Kconfig was not one of the possible choices. - Nucleo-F4X1RE User LEDS: Issue #51 reports compilation problems with stm32_userled.c. Reported by Gappi92. * TI Tiva Drivers: - Tiva I2C: Correct an error in conditional compilation. - Tiva SSI: Resolves issue 52 'Copy-Paste error in tiva_ssibus_initialize()' submitted by Aleksandr Kazantsev. * C Library/Header Files: - C Library vsnprintf(): Fix precision for string formatting. Fixes use of format precision to truncate input string. From Jussi Kivilinna. - C Library vsnprintf(): If size is zero, then vsnprintf() should return the size of the required buffer without writing anything. From Jussi Kivilinna. - C Library netdb: in dns_query_callback, ret != -EADDRNOTAVAIL condition consumes error returns including EAGAIN in this case, dns query retransmission doesn't work. From Ritajina. - C Library netdb: Fix time info in lib_dnscache.c. From Masayuki Ishikawa. - C Library netdb: Fix bugs in lib_gethostbynamer.c. This fix sets h_name in struct hostent returned by gethostbyname(). From Masayuki Ishikawa. - C Library Defect Workaround: replace '%6.6u' format with an equivalent '%06u'. From Tomasz Wozniak. * Tools - Fix mksyscall host binary name. From Alan Carvalho de Assis. * Applications (apps/) - Fix some calls to task_create(): argv[0] is the first parameter, not the name of the task. - Bitbucket Issue 5: I found an unexpected behavior in apps/ configuration generation. Adding external symbolic link in apps/ directory and using Make.defs for Kconfig generation, Kconfig file has a wrong path in the source argument. It contains original dir path outside of the source tree instead path to sub-directory in apps/. The problem is connected with make/system symbolic link path resolution. Corrected by a patch submitted by Artur Madrzak with Issue 5. - apps/: Make more globals static to avoid name clashes. From Juha Niskanen. * NSH: apps/nshlib: - NSH library: In nsh_argexand(), if CONFIG_NSH_ARGCAT is defined but CONFIG_NSH_CMDPARMS defined and/or CONFIG_DISABLE_ENVIRON not defined, then there is a situation that causes an infinite loop in the parser. Noted by Freddie Chopin. - NSH library: Fix building when CONFIG_NET_USRSOCK enabled with other link-layers. From Jussi Kivilinna. - NSH library: Fix some warnings about integer/pointer casts of different sizes (probably only effects 64-bit simulation). - NSH library: Fix open flags in nsh_codeccmd.c. From Masayuki Ishikawa. - I need to look at the registers that are at or around 0xe000ef90. Using mw and xd, I see that nsh does not support pointers greater than 0x7fffffff. A quick look at the source shows that the pointers for those two commands are set with calls to strtol() rather than strtoul(). Changing the two pointer-setting instances to strtoul() fixes the problem, at least for my architecture/config. From Ian McAfee. - NSH library: Fix a resource leak in cmd_hexdump(). From Nobutaka Toyoshima. * Examples/Tests: apps/examples: - apps/examples/hidkbd: Remove call to arch_usbhost_initialize(). That is violation of the OS interfacing rules and will no longer be supported. USB host should be initialized as part of the normal board bring-up logic as with any other devices and should not involve illegal calls from applications into the OS. - apps/examples/usbterm: Removed because it is not very useful and because it can be configured to use an illegal call into the OS. - examples/mm: Fix Makefile. Built-in was not being registered. - examples/hidkbd: Add some missing configuration settings. - examples/random: Avoid stack overflows. From Juha Niskanen. - examples/nettest: Fix an error in pre-processor expression. - examples/mtdpart: Prevent part array overflow. mtdpart examples create partitions and allocate from 1 index not a 0 index to part[] array. This cause buffer overflow for part array. This change fixes this problem. From EunBong Song. - examples/can: Fix can example app to print data when CONFIG_EXAMPLES_CAN_READ is defined. From Alan Carvalho de Assis. * Network Utilities: apps/netutils: - Not a clean fix, but at least makes DHCP working with CONFIG_NETDEV_MULTINIC. From Andreas Bihlmaier. - Ensure netlib will not be broken when setip will not bring the network up anymore. From Sebastien Lorquet. * CAN Utilities: apps/canutils: - Fix libcanard github download link to get it compiling correctly. From Alan Carvalho de Assis. - Fix to use the new canardInit() function. From Alan Carvalho de Assis. * System Utilities (apps/system) - system/dhcpc: Add missing argument of fprintf. * Tools (apps/tools): - The dedicated windows tool at tools/mkkconfig.bat uses $APPSDIR, which is not a windows shell variable, and is left uninitialized, but in fact should be the current directory. From Sebastien Lorquet.