title: Multilingual transfer of acoustic word embeddings improves when training on languages related to the target zero-resource language

abstract: Acoustic word embedding models map variable duration speech segments to fixed dimensional vectors, enabling efficient speech search and discovery. Previous work explored how embeddings can be obtained in zero-resource settings where no labelled data is available in the target language. The current best approach uses transfer learning: a single supervised multilingual model is trained using labelled data from multiple well-resourced languages and then applied to a target zero-resource language (without fine-tuning). However, it is still unclear how the specific choice of training languages affect downstream performance. Concretely, here we ask whether it is beneficial to use training languages related to the target. Using data from eleven languages spoken in Southern Africa, we experiment with adding data from different language families while controlling for the amount of data per language. In word discrimination and query-by-example search evaluations, we show that training on languages from the same family gives large improvements. Through finer-grained analysis, we show that training on even just a single related language gives the largest gain. We also find that adding data from unrelated languages generally doesn't hurt performance.


title: A Revisit to the ABS H2 Equation

abstract: In this paper we revisit the Adler-Bobenko-Suris H2 equation. The H2 equation is linearly related to the $S^{(0,0)}$ and $S^{(1,0)}$ variables in the Cauchy matrix scheme. We elaborate the coupled quad-system of $S^{(0,0)}$ and $S^{(1,0)}$ in terms of their 3-dimensional consistency, Lax pair, bilinear form and continuum limits. It is shown that $S^{(1,0)}$ itself satisfies a 9-point lattice equation and in continuum limit $S^{(1,0)}$ is related to the eigenfunction in the Lax pair of the Korteweg-de Vries equation.


title: A sparse approximate inverse for triangular matrices based on Jacobi iteration

abstract: In this paper, we propose a simple sparse approximate inverse for triangular matrices (SAIT). Using the Jacobi iteration method, we obtain an expression of the exact inverse of triangular matrix, which is a finite series. The SAIT is constructed based on this series. We apply the SAIT matrices to iterative methods with ILU preconditioners. The two triangular solvers in the ILU preconditioning procedure are replaced by two matrix-vector multiplications, which can be fine-grained parallelized. We test this method by solving some linear systems and eigenvalue problems with preconditioned iterative methods.


title: Modulus sheaves with transfers

abstract: We generalise Kahn, Miyazaki, Saito, Yamazaki's theory of modulus pairs to pairs $(X, D)$ consisting of a qcqs scheme $X$ equipped with an effective Cartier divisor $D$ representing a ramification bound. We develop theories of sheaves on such pairs for modulus versions of the Zariski, Nisnevich, \'etale, fppf, and qfh-topologies. We extend the Suslin-Voevodsky theory of correspondances to modulus pairs, under the assumption that the interior $U = X \setminus D$ is Noetherian. The resulting point of view highlights connections to (Raynaud-style) rigid geometry, and potentially provides a setting where wild ramification can be compared with irregular singularities. This framework leads to a homotopy theory of modulus pairs $\underline{M}H(X,D)$ and a theory of motives with modulus $\underline{M}DM^{eff}(X,D)$ over a general base $(X, D)$. For example, the case where $X$ is the spectrum of a rank one valuation ring (of mixed or equal characteristic) equipped with a choice $D$ of pseudo-uniformiser is allowed.


title: Gamma-Ray Burst in a Binary System

abstract: Regardless of their different types of progenitors and central engines, gamma-ray bursts (GRBs) were always assumed to be standalone systems after they formed. Little attention has been paid to the possibility that a stellar companion can still accompany a GRB itself. This paper investigates such a GRB-involved binary system and studies the effects of the stellar companion on the observed GRB emission when it is located inside the jet opening angle. Assuming a typical emission radius of $\sim10^{15}\,$cm, we show that the blockage by a companion star with a radius of $R_\mathrm{c}\sim67\,\mathrm{R_\odot}$ becomes non-negligible when it is located within a typical GRB jet opening angle (e.g., $\sim10$ degrees) and beyond the GRB emission site. In such a case, an on-axis observer will see a GRB with a similar temporal behavior but 25% dimmer. On the other hand, an off-axis observer outside the jet opening angle (hence missed the original GRB) can see a delayed "reflected" GRB, which is much fainter in brightness, much wider in the temporal profile and slightly softer in energy. Our study can naturally explain the origin of some low-luminosity GRBs. Moreover, we also point out that the companion star may be shocked if it is located inside the GRB emission site, which can give rise to an X-ray transient or a GRB followed by a delayed X-ray bump on top of X-ray afterglows.


title: Visualizing Graph Neural Networks with CorGIE: Corresponding a Graph to Its Embedding

abstract: Graph neural networks (GNNs) are a class of powerful machine learning tools that model node relations for making predictions of nodes or links. GNN developers rely on quantitative metrics of the predictions to evaluate a GNN, but similar to many other neural networks, it is difficult for them to understand if the GNN truly learns characteristics of a graph as expected. We propose an approach to corresponding an input graph to its node embedding (aka latent space), a common component of GNNs that is later used for prediction. We abstract the data and tasks, and develop an interactive multi-view interface called CorGIE to instantiate the abstraction. As the key function in CorGIE, we propose the K-hop graph layout to show topological neighbors in hops and their clustering structure. To evaluate the functionality and usability of CorGIE, we present how to use CorGIE in two usage scenarios, and conduct a case study with five GNN experts.


title: NN2CAM: Automated Neural Network Mapping for Multi-Precision Edge Processing on FPGA-Based Cameras

abstract: The record-breaking achievements of deep neural networks (DNNs) in image classification and detection tasks resulted in a surge of new computer vision applications during the past years. However, their computational complexity is restricting their deployment to powerful stationary or complex dedicated processing hardware, limiting their use in smart edge processing applications. We propose an automated deployment framework for DNN acceleration at the edge on field-programmable gate array (FPGA)-based cameras. The framework automatically converts an arbitrary-sized and quantized trained network into an efficient streaming-processing IP block that is instantiated within a generic adapter block in the FPGA. In contrast to prior work, the accelerator is purely logic and thus supports end-to-end processing on FPGAs without on-chip microprocessors. Our mapping tool features automatic translation from a trained Caffe network, arbitrary layer-wise fixed-point precision for both weights and activations, an efficient XNOR implementation for fully binary layers as well as a balancing mechanism for effective allocation of computational resources in the streaming dataflow. To present the performance of the system we employ this tool to implement two CNN edge processing networks on an FPGA-based high-speed camera with various precision settings showing computational throughputs of up to 337GOPS in low-latency streaming mode (no batching), running entirely on the camera.


title: Radial Migration from Metallicity Gradient of Open Clusters and Outliers

abstract: Radial migration is an important process in the evolution of the Galactic disk. The metallicity gradient of open clusters and its outliers provide an effective way to probe for this process. In this work, we compile metallicity, age, and kinematic parameters for 225 open clusters and carry out a quantitative analysis of radial migration via the calculated migration distances. Based on clusters with age $< 0.5$ Gyr, we obtain the present-day metallicity gradient of $-0.074 \pm 0.007$ dex/kpc. Along this gradient distributes three sequences, and clusters in the upper, the middle, and the lower groups are found to be old outward-migrators, in-situ clusters, and inward-migrators, respectively. The migration distance increases with age, but its most effective time is probably less than 3 Gyr. The metallicity gradient breaks out at $R_g$ (guiding center radius) $\sim11.5$ kpc, which is caused by the lack of young open clusters in the outer disk and the presence of old outward-migrators in the upper sequence. It shows that this boundary is related to the different effects of radial migration between the inner and outer disks. We also found many special open clusters in and near the outer disk of $R > 11$ kpc and a steeper metallicity gradient from the inner disk of $R_g < 7$ kpc, which tells a complicated evolution history of the Galactic disk by different effects of stellar radial migration.


title: Radiative thermal switch exploiting hyperbolic surface phonon polaritons

abstract: We study the radiative heat flux between two nanoparticles in close vicinity to the natural hyperbolic material hBN with its optical axis oriented parallel to the interface. We show that the heat flux between the nanoparticles can be efficiently modulated when rotating the nanoparticles due to the coupling to the highly directional hyperbolic surface modes in hBN. Finally, we discuss the thickness and distance dependence of this effect.


title: Redshift-space fluctuations in stochastic gravitational wave background

abstract: We study the redshift-space fluctuations induced by a stochastic gravitational wave background (SGWB) via the Sachs-Wolfe effect. The redshift-space fluctuations can be encapsulated in a line-of-sight integral that is useful for studying the imprint of short-wavelength gravitational waves on the cosmic microwave background (CMB) anisotropy. We thus derive constraints on the SGWB from small-scale CMB anisotropy measurements. Our results reproduce the constraint on the short-wavelength SGWB, previously derived from the Planck and BICEP/Keck array CMB data with a CMB Boltzmann numerical code. Furthermore, we improve the constraint and extend it to shorter wavelengths by using the CMB measurements made by the Atacama Cosmology Telescope and the South Pole Telescope. Also, the integral provides us with a precise redshift fluctuation correlation between a pair of pulsars in pulsar timing measurements, which conveniently incorporates the effect of the pulsar term into a small-angle correlation. We further discuss the observation of pulsar pairs in globular clusters to look for this small-angle correlation.


title: Bootstrap confidence intervals for multiple change points based on moving sum procedures

abstract: The problem of quantifying uncertainty about the locations of multiple change points by means of confidence intervals is addressed. The asymptotic distribution of the change point estimators obtained as the local maximisers of moving sum statistics is derived, where the limit distributions differ depending on whether the corresponding size of changes is local, i.e. tends to zero as the sample size increases, or fixed. A bootstrap procedure for confidence interval generation is proposed which adapts to the unknown magnitude of changes and guarantees asymptotic validity both for local and fixed changes. Simulation studies show good performance of the proposed bootstrap procedure, and some discussions about how it can be extended to serially dependent errors is provided.


title: Influence of the crust on the neutron star macrophysical quantities and universal relations

abstract: Measurements of neutron-star macrophysical properties thanks to multimessenger observations offer the possibility to constrain the properties of nuclear matter. Indeed cold and dense matter as found inside neutron stars, in particular in their core, is not accessible to terrestrial laboratories.We investigate the consequences of using equations of state that employ models for the core and the crust that are not calculated consistently on the neutron-star macrophysical properties, on some of the so-called universal relations and on the constraints obtained from gravitational-wave observations. We use various treatments found in the literature to connect together nonconsistent core and crust equations of state. We then compute the mass, the radius, the tidal deformability, and the moment of inertia for each model. Finally, we assess the discrepancies in the neutron-star macrophysical properties obtained when consistent models for the whole star and nonconsistent ones are employed. The use of crust models nonconsistent with the core introduces an error on the macrophysical parameters which can be as large as the estimated accuracy of current and next generation telescopes. The precision of some of the universal relations reported in the literature is found to be overestimated. We confirm that the equation of the crust has limited influence on the macrophysical properties. The discrepancy between results obtained for a fully consistent equation of state and a nonconsistent one can be reduced if one connects the core and the crust models at baryon densities around 0.08-0.1 fm$^{-3}$. The equation of the crust cannot be probed with current multimessenger observations and near-future ones.


title: Affine completeness of some free binary algebras

abstract: A function on an algebra is congruence preserving if, for any congruence, it maps pairs of congruent elements onto pairs of congruent elements. An algebra is said to be affine complete if every congruence preserving function is a polynomial function. We show that the algebra of (possibly empty) binary trees whose leaves are labeled by letters of an alphabet containing at least one letter, and the free monoid on an alphabet containing at least two letters are affine complete.


title: Construction of Evidently Positive Series and An Alternative Construction for a Family of Partition Generating Functions due to Kanade and Russell

abstract: We give an alternative construction for a family of partition generating functions due to Kanade and Russell. In our alternative construction, we use ordinary partitions instead of jagged partitions. We also present new generating functions which are evidently positive series for partitions due to Kanade and Russell. To obtain those generating functions, we first construct an evidently positive series for a key infinite product. In that construction, a series of combinatorial moves is used to decompose an arbitrary partition into a base partition together with some auxiliary partitions that bijectively record the moves.


title: Diffusive limit approximation of pure-jump optimal stochastic control problems

abstract: We consider the diffusive limit of a typical pure-jump Markovian control problem as the intensity of the driving Poisson process tends to infinity. We show that the convergence speed is provided by the H\"older constant of the Hessian of the limit problem, and explain how correction terms can be constructed. This provides an alternative efficient method for the numerical approximation of the optimal control of a pure-jump problem in situations with very high intensity of jump. We illustrate this approach in the context of a display advertising auction problem.


title: Resource Transition Systems and Full Abstraction for Linear Higher-Order Effectful Systems

abstract: We investigate program equivalence for linear higher-order(sequential) languages endowed with primitives for computational effects. More specifically, we study operationally-based notions of program equivalence for a linear $\lambda$-calculus with explicit copying and algebraic effects \emph{\`a la} Plotkin and Power. Such a calculus makes explicit the interaction between copying and linearity, which are intensional aspects of computation, with effects, which are, instead, \emph{extensional}. We review some of the notions of equivalences for linear calculi proposed in the literature and show their limitations when applied to effectful calculi where copying is a first-class citizen. We then introduce resource transition systems, namely transition systems whose states are built over tuples of programs representing the available resources, as an operational semantics accounting for both intensional and extensional interactive behaviors of programs. Our main result is a sound and complete characterization of contextual equivalence as trace equivalence defined on top of resource transition systems.


title: Transform-Based Feature Map Compression for CNN Inference

abstract: To achieve higher accuracy in machine learning tasks, very deep convolutional neural networks (CNNs) are designed recently. However, the large memory access of deep CNNs will lead to high power consumption. A variety of hardware-friendly compression methods have been proposed to reduce the data transfer bandwidth by exploiting the sparsity of feature maps. Most of them focus on designing a specialized encoding format to increase the compression ratio. Differently, we observe and exploit the sparsity distinction between activations in earlier and later layers to improve the compression ratio. We propose a novel hardware-friendly transform-based method named 1D-Discrete Cosine Transform on Channel dimension with Masks (DCT-CM), which intelligently combines DCT, masks, and a coding format to compress activations. The proposed algorithm achieves an average compression ratio of 2.9x (53% higher than the state-of-the-art transform-based feature map compression works) during inference on ResNet-50 with an 8-bit quantization scheme.


title: Additive Phoneme-aware Margin Softmax Loss for Language Recognition

abstract: This paper proposes an additive phoneme-aware margin softmax (APM-Softmax) loss to train the multi-task learning network with phonetic information for language recognition. In additive margin softmax (AM-Softmax) loss, the margin is set as a constant during the entire training for all training samples, and that is a suboptimal method since the recognition difficulty varies in training samples. In additive angular margin softmax (AAM-Softmax) loss, the additional angular margin is set as a costant as well. In this paper, we propose an APM-Softmax loss for language recognition with phoneitc multi-task learning, in which the additive phoneme-aware margin is automatically tuned for different training samples. More specifically, the margin of language recognition is adjusted according to the results of phoneme recognition. Experiments are reported on Oriental Language Recognition (OLR) datasets, and the proposed method improves AM-Softmax loss and AAM-Softmax loss in different language recognition testing conditions.


title: Momentum Density Spectroscopy of Pd: Comparison of 2D-ACAR and Compton Scattering Using a New 1D-to-2D Reconstruction Method

abstract: Two-dimensional angular correlation of annihilation radiation (2D-ACAR) and Compton scattering are both powerful techniques to investigate the bulk electronic structure of crystalline solids through the momentum density of the electrons. Here we apply both methods to a single crystal of Pd to study the electron momentum density and the occupancy in the first Brillouin zone, and to point out the complementary nature of the two techniques. To retrieve the 2D spectra from 1D Compton profiles, a new direct inversion method (DIM) is implemented and benchmarked against the well-established Cormack's method. The comparison of experimental spectra with first principles density functional theory calculations of the electron momentum density and the two photon momentum density clearly reveals the importance of positron probing effects on the determination of the electronic structure. While the calculations are in good agreement with the experimental data, our results highlight some significant discrepancies.


title: Magnon Transport in the Presence of Antisymmetric Exchange in a Weak Antiferromagnet

abstract: The Dzyaloshinskii-Moriya interaction (DMI) is at the heart of many modern developments in the research field of spintronics. DMI is known to generate noncollinear magnetic textures, and can take two forms in antiferromagnets: homogeneous or inter-sublattice, leading to small, canted moments and inhomogeneous or intra-sublattice, leading to formation of chiral structures. In this work, we first determine the strength of the effective field created by the DMI, using SQUID based magnetometry and transport measurements, in thin films of the antiferromagnetic iron oxide hematite, $\alpha$-Fe$_2$O$_3$. We demonstrate that DMI additionally introduces reconfigurability in the long distance magnon transport in these films under different orientations of a magnetic field. This arises as a hysteresis centred around the easy-axis direction for an external field rotated in opposing directions whose width decreases with increasing magnetic field as the Zeeman energy competes with the effective field created by the DMI.


title: Relativistic kinetic theory: toward the microscopic substantiation of zeroth law of thermodynamics

abstract: An exact closed relativistic kinetic equation is derived for a system of identical classical particles interacting with each other through a scalar field. The microscopic deterministic mechanism of the irreversible equilibration process in a relativistic classical system of interacting particles has been established. Keywords: Irreversible equilibration process; Classical relativistic dynamics; Retarded interactions.


title: Investigating the structure of gluon fluctuations in the proton with incoherent diffraction at HERA

abstract: Impact parameter dependent dipole models are ideal tools for investigating the spatial structure of the proton. We investigate the incoherent $ep$ cross section in exclusive $J/\psi$ photoproduction as measured by HERA, and find that as $|t|$ increases, the models need several levels of the substructure of gluon density fluctuations in order to describe the measured data well. In lieu of a perturbative description, we add this substructure by hand. This substructure is modelled as hotspots within hotspots. This enables us to describe measurements for $|t|> 1$~GeV$^2$, which is necessary for describing any observable which integrates over the $t$-spectrum, such as the rapidity or $W_{\gamma p}$. We find that three levels of proton substructure are adequate for a good description of all available $ep$ data up to $|t|=30~$GeV$^2$. We note that the gluonic density fluctuation structure follows a scaling behaviour, such that the logarithms of the number of hotspots and their size fall on a line, effectively reducing the available parameter space of the model. Our findings systematically constrain and provide a benchmark for the development of a perturbative model of spatial gluon fluctuations in nucleons.


title: The maximum discrete surface-to-volume ratio of space-filling curve partitions

abstract: Space-filling curves (SFCs) are used in high performance computing to distribute a computational domain or its mesh, respectively, amongst different compute units, i.e.~cores or nodes or accelerators. The part of the domain allocated to each compute unit is called a partition. Besides the balancing of the work, the communication cost to exchange data between units determines the quality of a chosen partition. This cost can be approximated by the surface-to-volume ratio of partitions: the volume represents the amount of local work, while the surface represents the amount of data to be transmitted. Empirical evidence suggests that space-filling curves yield advantageous surface-to-volume ratios. Formal proofs are available only for regular grids. We investigate the surface-to-volume ratio of space-filling curve partitions for adaptive grids and derive the maximum surface-to-volume ratio as a function of the number of cells in the partition. In order to prove our main theorem, we construct a new framework for the study of adaptive grids, notably introducing the concepts of a shape and of classified partitions. The new methodological framework yields insight about the SFC-induced partition character even if the grids refine rather aggressively in localised areas: it quantifies the obtained surface-to-volume ratio. This framework thus has the potential to guide the design of better load balancing algorithms on the long term.


title: Pattern-based Visualization of Knowledge Graphs

abstract: We present a novel approach to knowledge graph visualization based on ontology design patterns. This approach relies on OPLa (Ontology Pattern Language) annotations and on a catalogue of visual frames, which are associated with foundational ontology design patterns. We demonstrate that this approach significantly reduces the cognitive load required to users for visualizing and interpreting a knowledge graph and guides the user in exploring it through meaningful thematic paths provided by ontology patterns.


title: Adaptive Relaxations for Multistage Robust Optimization

abstract: Multistage robust optimization problems can be interpreted as two-person zero-sum games between two players. We exploit this game-like nature and utilize a game tree search in order to solve quantified integer programs (QIPs). In this algorithmic environment relaxations are repeatedly called to asses the quality of a branching variable and for the generation of bounds. A useful relaxation, however, must be well balanced with regard to its quality and its computing time. We present two relaxations that incorporate scenarios from the uncertainty set, whereby the considered set of scenarios is continuously adapted according to the latest information gathered during the search process. Using selection, assignment, and runway scheduling problems as a testbed, we show the impact of our findings.


title: Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images

abstract: Traditional feature-based image stitching technologies rely heavily on feature detection quality, often failing to stitch images with few features or low resolution. The learning-based image stitching solutions are rarely studied due to the lack of labeled data, making the supervised methods unreliable. To address the above limitations, we propose an unsupervised deep image stitching framework consisting of two stages: unsupervised coarse image alignment and unsupervised image reconstruction. In the first stage, we design an ablation-based loss to constrain an unsupervised homography network, which is more suitable for large-baseline scenes. Moreover, a transformer layer is introduced to warp the input images in the stitching-domain space. In the second stage, motivated by the insight that the misalignments in pixel-level can be eliminated to a certain extent in feature-level, we design an unsupervised image reconstruction network to eliminate the artifacts from features to pixels. Specifically, the reconstruction network can be implemented by a low-resolution deformation branch and a high-resolution refined branch, learning the deformation rules of image stitching and enhancing the resolution simultaneously. To establish an evaluation benchmark and train the learning framework, a comprehensive real-world image dataset for unsupervised deep image stitching is presented and released. Extensive experiments well demonstrate the superiority of our method over other state-of-the-art solutions. Even compared with the supervised solutions, our image stitching quality is still preferred by users.


title: A micropolar isotropic plasticity formulation for non-associated flow rule and softening featuring multiple classical yield criteria Part I -- Theory

abstract: The Cosserat continuum is used in this paper to regularize the ill-posed governing equations of the Cauchy/Maxwell continuum. Most available constitutive models adopt yield and plastic potential surfaces with a circular deviatoric section. This is a too crude an approximation which hinders the application of the Cosserat continuum into practice, particularly in the geotechnical domain. An elasto-plastic constitutive model for the linear formulation of the Cosserat continuum is here presented, which features non-associated flow and hardening/softening behaviour, whilst linear hyper-elasticity is adopted to reproduce the recoverable response. For the formulation of the yield and plastic potential functions, a definition of the \textit{equivalent von Mises stress} is used which is based on Hencky's interpretation of the von Mises criterion and also on the theory of representations. The dependency on the Lode's angle of both the yield and plastic potential functions is introduced through the adoption of a recently proposed \textit{Generalized classical} criterion, which rigorously defines most of the classical yield and failure criteria.


title: Many-body localization and the area law in two dimensions

abstract: We study the high-energy phase diagram of a two-dimensional spin-$\frac{1}{2}$ Heisenberg model on a square lattice in the presence of either quenched or quasiperiodic disorder. The use of large-scale tensor network numerics allows us to compute the bipartite entanglement entropy for systems of up to $60 \times 7$ lattice sites. We provide evidence for the existence of a many-body localized regime for large disorder strength that features an area law in excited states and that violates the eigenstate thermalization hypothesis. From a finite-size analysis, we determine an estimate for the critical disorder strength where the transition to the ergodic regime occurs in the quenched case.


title: Regenerative Terahertz Quantum Detectors

abstract: Because of the ultrafast and photon-driven nature of the transport in their active region, we demonstrate that quantum cascade lasers can be operated as resonantly amplified terahertz detectors. Tunable responsivities up to 50 V/W and noise equivalent powers down to 100 pW/sqrt(Hz) are demonstrated at 4.7 THz. Constant peak responsivities with respect to the detector temperature are observed up to 80K. Thanks to the sub-ps intersubband lifetime electrical bandwidths larger than 20 GHz can be obtained, allowing the detection of optical beatnotes from quantum cascade THz frequency combs.


title: Choice of Parallelism: Multi-GPU Driven Pipeline for Huge Academic Backbone Network

abstract: Science Information Network (SINET) is a Japanese academic backbone network for more than 800 research institutions and universities. In this paper, we present a multi-GPU-driven pipeline for handling huge session data of SINET. Our pipeline consists of ELK stack, multi-GPU server, and Splunk. A multi-GPU server is responsible for two procedures: discrimination and histogramming. Discrimination is dividing session data into ingoing/outgoing with subnet mask calculation and network address matching. Histogramming is grouping ingoing/outgoing session data into bins with map-reduce. In our architecture, we use GPU for the acceleration of ingress/egress discrimination of session data. Also, we use a tiling design pattern for building a two-stage map-reduce of CPU and GPU. Our multi-GPU-driven pipeline has succeeded in processing huge workloads of about 1.2 to 1.6 billion session streams (500GB-650GB) within 24 hours.


title: A Systematic Collection of Medical Image Datasets for Deep Learning

abstract: The astounding success made by artificial intelligence (AI) in healthcare and other fields proves that AI can achieve human-like performance. However, success always comes with challenges. Deep learning algorithms are data-dependent and require large datasets for training. The lack of data in the medical imaging field creates a bottleneck for the application of deep learning to medical image analysis. Medical image acquisition, annotation, and analysis are costly, and their usage is constrained by ethical restrictions. They also require many resources, such as human expertise and funding. That makes it difficult for non-medical researchers to have access to useful and large medical data. Thus, as comprehensive as possible, this paper provides a collection of medical image datasets with their associated challenges for deep learning research. We have collected information of around three hundred datasets and challenges mainly reported between 2013 and 2020 and categorized them into four categories: head & neck, chest & abdomen, pathology & blood, and ``others''. Our paper has three purposes: 1) to provide a most up to date and complete list that can be used as a universal reference to easily find the datasets for clinical image analysis, 2) to guide researchers on the methodology to test and evaluate their methods' performance and robustness on relevant datasets, 3) to provide a ``route'' to relevant algorithms for the relevant medical topics, and challenge leaderboards.


title: From pre- to post-big bang: an (almost) self-dual cosmological history

abstract: We present a short introduction to a non-standard cosmological scenario motivated by the duality symmetries of string theory, in which the big bang singularity is replaced with a "big bounce" at high but finite curvature. The bouncing epoch is prepared by a long (possibly infinitely extended) phase of cosmic evolution, starting from an initial state asymptotically approaching the string perturbative vacuum.


title: Hoyle-Lyttleton accretion on to black hole accretion disks with super-Eddington luminosity for dusty gas

abstract: We investigate the Hoyle-Lyttleton accretion of dusty-gas for the case where the central source is the black hole accretion disk. By solving the equation of motion taking into account the radiation force which is attenuated by the dust absorption, we reveal the steady structure of the flow around the central object. We find that the mass accretion rate tends to increase with an increase of the optical thickness of the flow and the gas can accrete even if the disk luminosity exceeds the Eddington luminosity for the dusty-gas, since the radiation force is weakened by the attenuation via the dust absorption. When the gas flows in from the direction of the rotation axis for the disk with ${\Gamma}^{'}=3.0$, the accretion rate is about 93% of the Hoyle-Lyttleton accretion rate if ${\tau}_{\rm{HL}}=3.3$ and zero for ${\tau}_{\rm{HL}}=1.0$, where ${\Gamma}^{'}$ is the Eddington ratio for the dusty-gas and ${\tau}_{\rm{HL}}$ is the typical optical thickness of the Hoyle-Lyttleton radius. Since the radiation flux in the direction of disk plane is small, the radiation force tends not to prevent gas accretion from the direction near the disk plane. For ${\tau}_{\rm{HL}}=3.3$ and ${\Gamma}^{'}=3.4$, although the accretion is impossible in the case of ${\Theta}=0$, the accretion rate is 28% of the Hoyle-Lyttleton one in the case of ${\Theta}=90$, where ${\Theta}$ is the angle between the direction the gas is coming from and the rotation axis of the disk. We also obtain relatively high accretion luminosity that is realized when the accretion rate of the disk onto the BH is consistent with that via the Hoyle-Lyttleton mechanism taking into account the effect of radiation. This implies the intermediate-mass black holes moving in the dense dusty-gas are identified as luminous objects in the infrared band.


title: Density functional theory study of the structural, electronic, and surface reaction properties of bismuth vanady1 oxyhalide BiVO3F

abstract: BiVO3F is a promising material used in solar energy conversion systems. Here, we first report the calculated structural, electronic, and surface reaction properties using PBE and hybrid density functionals. We found it is a direct band gap semiconductor, and the calculated band gap is consistent with experimental value only using the hybrid density functional with a fraction of Hartree Fock (HF) exchange {\alpha}=0.1. The (001) surface is the most stable surface among all the low index (001), (010), and (100) surfaces. There are V and Bi sites exposed on (001) surface which can serves as activity sites. That is quite different from BiVO4 where only Bi sties can be taken as surface reaction sites. The OER intermediates OH* and OOH* prefer to form a bridge structure on both V and Bi sites. This makes the first proton removal step is very easy, but the O-O bond is difficult to form which leads the overpotential of OER is very high. Our work plays a guide principle to design the high efficiency photocatalysis and photoanodes based on BiVO3F.


title: Awareness Logic: Kripke Lattices as a Middle Ground between Syntactic and Semantic Models

abstract: The literature on awareness modeling includes both syntax-free and syntax-based frameworks. Heifetz, Meier \& Schipper (HMS) propose a lattice model of awareness that is syntax-free. While their lattice approach is elegant and intuitive, it precludes the simple option of relying on formal language to induce lattices, and does not explicitly distinguish uncertainty from unawareness. Contra this, the most prominent syntax-based solution, the Fagin-Halpern (FH) model, accounts for this distinction and offers a simple representation of awareness, but lacks the intuitiveness of the lattice structure. Here, we combine these two approaches by providing a lattice of Kripke models, induced by atom subset inclusion, in which uncertainty and unawareness are separate. We show our model equivalent to both HMS and FH models by defining transformations between them which preserve satisfaction of formulas of a language for explicit knowledge, and obtain completeness through our and HMS' results. Lastly, we prove that the Kripke lattice model can be shown equivalent to the FH model (when awareness is propositionally determined) also with respect to the language of the Logic of General Awareness, for which the FH model where originally proposed.


title: A micropolar isotropic plasticity formulation for non associated flow rule and softening featuring multiple classical yield criteria. Part II -- FE integration and applications

abstract: A Finite Element procedure based on a full implicit backward Euler predictor/corrector scheme for the Cosserat continuum is here presented. Since this is based on invariants of the stress and couple stress tensors and on the spectral decomposition of the former, considerable benefits are achieved. The integration requires the solution of a single equation in a single unknown, which is a considerable improvement as compared to the system of seven or four equations required by other approaches available in the literature for the Cauchy medium. The scheme also allows for a very efficient treatment of the singularity which affects the apex of most of the existing yield and plastic potential surfaces. Moreover, no complications arise when some of the principal stresses coincide. The algorithm has been implemented in a proprietary Finite Element program, and used for the constitutive model proposed in part I of this paper. Numerical analyses have been conducted to simulate a biaxial compression test and a shallow strip footing resting on a Tresca, Mohr-Coulomb, Matsuoka-Nakai and Lade-Duncan soil. The benefits of the Cosserat continuum over the Cauchy/Maxwell medium are discussed considering mesh refinement, non-associated flow and softening behaviour.


title: Prospects on searches for baryonic Dark Matter produced in $b$-hadron decays at LHCb

abstract: A model that can simultaneously explain Dark Matter relic density and the apparent matter anti-matter imbalance of the universe has been recently proposed. The model requires $b$-hadron branching fractions to Dark Matter at the per mille level. The $b$-hadrons decay to a dark sector baryon, $\psi_{\rm{DS}}$, which has a mass in the region $940$ MeV/c$^{2} \leq m(\psi_{\rm{DS}}) \leq 4430$ MeV/c$^{2}$. In this paper, we discuss the sensitivity of the LHCb experiment to search for this dark baryon, covering different types of topology and giving prospects for Runs 3 and 4 of the LHC, as well as for the proposed Phase-II Upgrade. We show that the LHCb experiment can cover the entire mass range of the hypothetical dark baryon.


title: DCoM: A Deep Column Mapper for Semantic Data Type Detection

abstract: Detection of semantic data types is a very crucial task in data science for automated data cleaning, schema matching, data discovery, semantic data type normalization and sensitive data identification. Existing methods include regular expression-based or dictionary lookup-based methods that are not robust to dirty as well unseen data and are limited to a very less number of semantic data types to predict. Existing Machine Learning methods extract large number of engineered features from data and build logistic regression, random forest or feedforward neural network for this purpose. In this paper, we introduce DCoM, a collection of multi-input NLP-based deep neural networks to detect semantic data types where instead of extracting large number of features from the data, we feed the raw values of columns (or instances) to the model as texts. We train DCoM on 686,765 data columns extracted from VizNet corpus with 78 different semantic data types. DCoM outperforms other contemporary results with a quite significant margin on the same dataset.


title: Boundedness criterion for sublinear operators and commutators on generalized mixed Morrey spaces

abstract: In this paper, the author studies the boundedness for a large class of sublinear operator $T_\alpha, \alpha\in[0,n)$ generated by Calder{\'o}n-Zygmund operators ($\alpha=0$) and generated by fractional integral operator ($\alpha>0$) on generalized mixed Morrey spaces $M^\varphi_{\vec{q}}(\Bbb R^n)$. Moreover, the boundeness for the commutators of $T_\alpha, \alpha\in[0,n)$ on generalized mixed Morrey spaces $M^\varphi_{\vec{q}}(\Bbb R^n)$ is also studied. As applications, we obtain the boundedness for Hardy-Littlewood maximal operator, Calder\'on-Zygmund singular integral operators, fractional integral operator, fractional maximal operator and their commutators on generalzied mixed Morrey spaces.


title: User Scheduling for Precoded Satellite Systems with Individual Quality of Service Constraints

abstract: Multibeam high throughput satellite (MB-HTS) systems will play a key role in delivering broadband services to a large number of users with diverse Quality of Service (QoS) requirements. This paper focuses on MB-HTS where the same spectrum is re-used by all user links and, in particular, we propose a novel user scheduling design capable to provide guarantees in terms of individual QoS requirements while maximizing the system throughput. This is achieved by precoding to mitigate mutual interference. The combinatorial optimization structure requires an extremely high cost to obtain the global optimum even with a reduced number of users. We, therefore, propose a heuristic algorithm yielding a good local solution and tolerable computational complexity, applicable for large-scale networks. Numerical results demonstrate the effectiveness of our proposed algorithm on scheduling many users with better sum throughput than the other benchmarks. Besides, the QoS requirements for all scheduled users are guaranteed.


title: 3-dimensional $\Lambda$-BMS Symmetry and its Deformations

abstract: In this paper we study quantum group deformations of the infinite dimensional symmetry algebra of asymptotically AdS spacetimes in three dimensions. Building on previous results in the finite dimensional subalgebras we classify all possible Lie bialgebra structures and for selected examples, we explicitly construct the related Hopf algebras. Using cohomological arguments we show that this construction can always be performed by a so-called twist deformation. The resulting structures can be compared to the well-known $\kappa$-Poincar\'e Hopf algebras constructed on the finite dimensional Poincar\'e or (anti) de Sitter algebra. The dual $\kappa$ Minkowski spacetime is supposed to describe a specific non-commutative geometry. Importantly, we find that some incarnations of the $\kappa$-Poincar\'e can not be extended consistently to the infinite dimensional algebras. Furthermore, certain deformations can have potential physical applications if subalgebras are considered. Since the conserved charges associated with asymptotic symmetries in 3-dimensional form a centrally extended algebra we also discuss briefly deformations of such algebras. The presence of the full symmetry algebra might have observable consequences that could be used to rule out these deformations. }


title: Detection, Analysis, and Prediction of Research Topics with Scientific Knowledge Graphs

abstract: Analysing research trends and predicting their impact on academia and industry is crucial to gain a deeper understanding of the advances in a research field and to inform critical decisions about research funding and technology adoption. In the last years, we saw the emergence of several publicly-available and large-scale Scientific Knowledge Graphs fostering the development of many data-driven approaches for performing quantitative analyses of research trends. This chapter presents an innovative framework for detecting, analysing, and forecasting research topics based on a large-scale knowledge graph characterising research articles according to the research topics from the Computer Science Ontology. We discuss the advantages of a solution based on a formal representation of topics and describe how it was applied to produce bibliometric studies and innovative tools for analysing and predicting research dynamics.


title: Magnetic skyrmion generation by reflective spin-wave focusing

abstract: We propose a method to generate magnetic skyrmions by focusing spin waves totally reflected by a curved film edge. Based on the principle of identical magnonic path length, we derive the edge contour that is parabolic and frequency-independent. Micromagnetic simulations are performed to verify our theoretical design. It is found that under proper conditions, magnetic droplet first emerges near the focal point where the spin-wave intensity has been significantly enhanced, and then converts to magnetic skyrmion accompanied by a change of the topological charge. The phase diagram about the amplitude and frequency of the driving field for skyrmion generation is obtained. Our finding would be helpful for the designment of spintronic devices combing the advantage of skyrmionics and magnonics.


title: Hierarchical porosity ihnerited by natural sources affects the mechanical and biological behaviour of bone scaffolds

abstract: A 3-D porous apatite scaffold (B-HA), recently obtained through biomorphic transformation of a natural wood, is investigated on its multi-scale porous structure determining superior mechanical properties and biological behaviour. B-HA shows hierarchical pore architecture with wide aligned channels interconnected with smaller tubules, thus recapitulating in detail the lymphatic network of the original wood template. As induced by its biomimetic architecture, B-HA displays values of compression and tensile strength and stiffness, higher than the values usually measured in sintered ceramics with isotropic porosity. Furthermore, B-HA shows a ductility not common for a pure ceramic body and a tensile strength higher than its compression strength, thus occupying a zone in the Ashby chart where ceramics are usually not present. Cell co-culture tests in bioreactor report encouraging results in enhancing the complex tissue regeneration process, thus making B-HA very promising as a scaffold able to promote bone regeneration, particularly for large bone defects.


title: Projection of strong coupling interaction with thermal bath in a polymer

abstract: We investigate modifications of a stochastic polymer picture through a shift in the boundary between the system and an external environment. A conventional bead-and-spring model serving as the coarse-graining model is given by the Langevin equation for all the monomers subject to white noise. However, stochastic motion for only a tagged monomer is observed to occur in the presence of colored noise. The qualitative change in the observations arises from the boundary shift decided by the observer. The Langevin dynamics analyses interpret the colored noise as the emergence of the polymeric elastic force, resulting in additional heat in the tagged monomer observation. Being distinguished from coarse-graining based on scale separation, the projection of comparable internal degrees of freedom is also discussed in light of the fluctuation theorem and the stochastic polymer thermodynamics.


title: Decoding a class of maximum Hermitian rank metric codes

abstract: Maximum Hermitian rank metric codes were introduced by Schmidt in 2018 and in this paper we propose both interpolation-based encoding and decoding algorithms for this family of codes when the length and the minimum distance of the code are both odd.


title: Towards Measuring and Quantifying the Comprehensibility of Process Models -- The Process Model Comprehension Framework

abstract: Process models constitute crucial artifacts in modern information systems and, hence, the proper comprehension of these models is of utmost importance in the utilization of such systems. Generally, process models are considered from two different perspectives: process modelers and readers. Both perspectives share similarities and differences in the comprehension of process models (e.g., diverse experiences when working with process models). The literature proposed many rules and guidelines to ensure a proper comprehension of process models for both perspectives. As a novel contribution in this context, this paper introduces the Process Model Comprehension Framework (PMCF) as a first step towards the measurement and quantification of the perspectives of process modelers and readers as well as the interaction of both regarding the comprehension of process models. Therefore, the PMCF describes an Evaluation Theory Tree based on the Communication Theory as well as the Conceptual Modeling Quality Framework and considers a total of 96 quality metrics in order to quantify process model comprehension. Furthermore, the PMCF was evaluated in a survey with 131 participants and has been implemented as well as applied successfully in a practical case study including 33 participants. To conclude, the PMCF allows for the identification of pitfalls and provides related information about how to assist process modelers as well as readers in order to foster and enable a proper comprehension of process models.


title: Preaveraging description of polymer nonequilibrium stretching

abstract: This article focuses on a preaveraging description of polymer nonequilibrium stretching, where a single polymer undergoes a transient process from equilibrium to nonequilibrium steady state by pulling one chain end. The preaveraging method combined with mode analysis reduces the original Langevin equation to a simplified form for both a stretched steady state and an equilibrium state, even in the presence of self-avoiding repulsive interactions spanning a long range. However, the transient stretching process exhibits evolution of a hierarchal regime structure, which means a qualitative temporal change in probabilistic distributions assumed in preaveraging. We investigate the preaveraging method for evolution of the regime structure with consideration of the nonequilibrium work relations and deviations from the fluctuation-dissipation relation.


title: Efficient Quantum Simulation of Open Quantum System Dynamics on Noisy Quantum Computers

abstract: Quantum simulation represents the most promising quantum application to demonstrate quantum advantage on near-term noisy intermediate-scale quantum (NISQ) computers, yet available quantum simulation algorithms are prone to errors and thus difficult to be realized. Herein, we propose a novel scheme to utilize intrinsic gate errors of NISQ devices to enable controllable simulation of open quantum system dynamics without ancillary qubits or explicit bath engineering, thus turning unwanted quantum noises into useful quantum resources. Specifically, we simulate energy transfer process in a photosynthetic dimer system on IBM-Q cloud. By employing designed decoherence-inducing gates, we show that quantum dissipative dynamics can be simulated efficiently across coherent-to-incoherent regimes with results comparable to those of the numerically-exact classical method. Moreover, we demonstrate a calibration routine that enables consistent and predictive simulations of open-quantum system dynamics in the intermediate coupling regime. This work provides a new direction for quantum advantage in the NISQ era.


title: Optimizing Intelligent Reflecting Surface-Base Station Association for Mobile Networks

abstract: This paper studies a multi-Intelligent Reflecting Surfaces (IRSs)-assisted wireless network consisting of multiple base stations (BSs) serving a set of mobile users. We focus on the IRS-BS association problem in which multiple BSs compete with each other for controlling the phase shifts of a limited number of IRSs to maximize the long-term downlink data rate for the associated users. We propose MDLBI, a Multi-agent Deep Reinforcement Learning-based BS-IRS association scheme that optimizes the BS-IRS association as well as the phase-shift of each IRS when being associated with different BSs. MDLBI does not require information exchanging among BSs. Simulation results show that MDLBI achieves significant performance improvement and is scalable for large networking systems.


title: A Novel Compact Tri-Band Antenna Design for WiMAX, WLAN and Bluetooth Applications

abstract: A novel and compact tri-band planar antenna for 2.4/5.2/5.8-GHz wireless local area network (WLAN), 2.3/3.5/5.5GHz Worldwide Interoperability for Microwave Access (WiMAX) and Bluetooth applications is proposed and studied in this paper. The antenna comprises of a L-shaped element which is coupled with a ground shorted parasitic resonator to generate three resonant modes for tri-band operation. The L-shaped element which is placed on top of the substrate is fed by a 50$\Omega$ microstrip feed line and is responsible for the generation of a wide band at 5.5 GHz. The parasitic resonator is placed on the other side of the substrate and is directly connected to the ground plane. The presence of the parasitic resonator gives rise to two additional resonant bands at 2.3 GHz and 3.5 GHz. Thus, together the two elements generate three resonant bands to cover WLAN, WiMAX and Bluetooth bands of operation. A thorough parametric study has been performed on the antenna and it has been found that the three bands can be tuned by varying certain dimensions of the antenna. Hence, the same design can be used for frequencies in adjacent bands as well with minor changes in its dimensions. Important antenna parameters such as return loss, radiation pattern and peak gains in the operating bands have been studied in detail to prove that the proposed design is a promising candidate for the aforementioned wireless technologies.


title: Identifying Hidden Visits from Sparse Call Detail Record Data

abstract: Despite a large body of literature on trip inference using call detail record (CDR) data, a fundamental understanding of their limitations is lacking. In particular, because of the sparse nature of CDR data, users may travel to a location without being revealed in the data, which we refer to as a "hidden visit". The existence of hidden visits hinders our ability to extract reliable information about human mobility and travel behavior from CDR data. In this study, we propose a data fusion approach to obtain labeled data for statistical inference of hidden visits. In the absence of complementary data, this can be accomplished by extracting labeled observations from more granular cellular data access records, and extracting features from voice call and text messaging records. The proposed approach is demonstrated using a real-world CDR dataset of 3 million users from a large Chinese city. Logistic regression, support vector machine, random forest, and gradient boosting are used to infer whether a hidden visit exists during a displacement observed from CDR data. The test results show significant improvement over the naive no-hidden-visit rule, which is an implicit assumption adopted by most existing studies. Based on the proposed model, we estimate that over 10% of the displacements extracted from CDR data involve hidden visits. The proposed data fusion method offers a systematic statistical approach to inferring individual mobility patterns based on telecommunication records.


title: Constrained Classification and Policy Learning

abstract: Modern machine learning approaches to classification, including AdaBoost, support vector machines, and deep neural networks, utilize surrogate loss techniques to circumvent the computational complexity of minimizing empirical classification risk. These techniques are also useful for causal policy learning problems, since estimation of individualized treatment rules can be cast as a weighted (cost-sensitive) classification problem. Consistency of the surrogate loss approaches studied in Zhang (2004) and Bartlett et al. (2006) crucially relies on the assumption of correct specification, meaning that the specified set of classifiers is rich enough to contain a first-best classifier. This assumption is, however, less credible when the set of classifiers is constrained by interpretability or fairness, leaving the applicability of surrogate loss based algorithms unknown in such second-best scenarios. This paper studies consistency of surrogate loss procedures under a constrained set of classifiers without assuming correct specification. We show that in the setting where the constraint restricts the classifier's prediction set only, hinge losses (i.e., $\ell_1$-support vector machines) are the only surrogate losses that preserve consistency in second-best scenarios. If the constraint additionally restricts the functional form of the classifier, consistency of a surrogate loss approach is not guaranteed even with hinge loss. We therefore characterize conditions for the constrained set of classifiers that can guarantee consistency of hinge risk minimizing classifiers. Exploiting our theoretical results, we develop robust and computationally attractive hinge loss based procedures for a monotone classification problem.


title: A Near-Optimal Algorithm for Debiasing Trained Machine Learning Models

abstract: We present a scalable post-processing algorithm for debiasing trained models, including deep neural networks (DNNs), which we prove to be near-optimal by bounding its excess Bayes risk. We empirically validate its advantages on standard benchmark datasets across both classical algorithms as well as modern DNN architectures and demonstrate that it outperforms previous post-processing methods while performing on par with in-processing. In addition, we show that the proposed algorithm is particularly effective for models trained at scale where post-processing is a natural and practical choice.


title: COVID-19 cases prediction using regression and novel SSM model for non-converged countries

abstract: Anticipating the quantity of new associated or affirmed cases with novel coronavirus ailment 2019 (COVID-19) is critical in the counteraction and control of the COVID-19 flare-up. The new associated cases with COVID-19 information were gathered from 20 January 2020 to 21 July 2020. We filtered out the countries which are converging and used those for training the network. We utilized the SARIMAX, Linear regression model to anticipate new suspected COVID-19 cases for the countries which did not converge yet. We predict the curve of non-converged countries with the help of proposed Statistical SARIMAX model (SSM). We present new information investigation-based forecast results that can assist governments with planning their future activities and help clinical administrations to be more ready for what's to come. Our framework can foresee peak corona cases with an R-Squared value of 0.986 utilizing linear regression and fall of this pandemic at various levels for countries like India, US, and Brazil. We found that considering more countries for training degrades the prediction process as constraints vary from nation to nation. Thus, we expect that the outcomes referenced in this work will help individuals to better understand the possibilities of this pandemic.


title: Assessing the Value of Complex Refractive Index and Particle Density for Calibration of Low-Cost Particle Matter Sensor for Size-Resolved Particle Count and PM2.5 Measurements

abstract: Commercially available low-cost particulate matter (PM) sensors provide output as total or size-specific particle counts and mass concentrations. These quantities are not measured directly but are estimated by the original equipment manufacturers' (OEM) proprietary algorithms and have inherent limitations since particle scattering depends on their composition, size, shape, and complex index of refraction (CRI). Hence, there is a need to characterize and calibrate their performance under a controlled environment. We present calibration algorithms for Plantower PMS A003 sensor as a function of particle size and concentration. A standardized experimental protocol was used to control the PM level, environmental conditions and to evaluate sensor-to-sensor reproducibility. The calibration was based on tests when PMS A003 were exposed to different polydisperse standardized testing aerosols. The results suggested particle size distribution from PMS A003 was shifted compared to reference instrument measures. For calibration of number concentration, linear model without adjusting aerosol properties corrects the raw PMS A003 measurement for specific size bins with normalized mean absolute error within 4.0% of the reference instrument. Although the Bayesian Information Criterion suggests that models adjusting for particle optical properties and relative humidity are technically superior, they should be used with caution as the particle properties used in fitting were within a narrow range for challenge aerosols. The calibration models adjusted for particle CRI and density account for non-linearity in the OEM's mass concentrations estimates and demonstrated lower error. These results have significant implications for using PMS A003 in high concentration environments, including indoor air quality and occupational/industrial exposure assessments, wildfire smoke, or near-source monitoring scenarios.


title: A Proton Computed Tomography Demonstrator for Stopping Power Measurements

abstract: Particle therapy is an established method to treat deep-seated tumours using accelerator-produced ion beams. For treatment planning, the precise knowledge of the relative stopping power (RSP) within the patient is vital. Conversion errors from x-ray computed tomography (CT) measurements to RSP introduce uncertainties in the applied dose distribution. Using a proton computed tomography (pCT) system to measure the SP directly could potentially increase the accuracy of treatment planning. A pCT demonstrator, consisting of double-sided silicon strip detectors (DSSD) as tracker and plastic scintillator slabs coupled to silicon photomultipliers (SiPM) as a range telescope, was developed. After a significant hardware upgrade of the range telescope, a 3D tomogram of an aluminium stair phantom was recorded at the MedAustron facility in Wiener Neustadt, Austria. In total, 80 projections with 6.5x10^5 primary events were acquired and used for the reconstruction of the RSP distribution in the phantom. After applying a straight-line approximation for the particle path inside the phantom, the most probable value (MPV) of the RSP distribution could be measured with an accuracy of 0.59%. The RSP resolution inside the phantom was only 9.3% due to a limited amount of projections and measured events per projection.


title: Encoding Involutory Invariances in Neural Networks

abstract: In certain situations, neural networks are trained upon data that obey underlying symmetries. However, the predictions do not respect the symmetries exactly unless embedded in the network structure. In this work, we introduce architectures that embed a special kind of symmetry namely, invariance with respect to involutory linear/affine transformations up to parity $p=\pm 1$. We provide rigorous theorems to show that the proposed network ensures such an invariance and present qualitative arguments for a special universal approximation theorem. An adaption of our techniques to CNN tasks for datasets with inherent horizontal/vertical reflection symmetry is demonstrated. Extensive experiments indicate that the proposed model outperforms baseline feed-forward and physics-informed neural networks while identically respecting the underlying symmetry.


title: Semiring Provenance for B\"uchi Games: Strategy Analysis with Absorptive Polynomials

abstract: This paper presents a case study for the application of semiring semantics for fixed-point formulae to the analysis of strategies in B\"uchi games. Semiring semantics generalizes the classical Boolean semantics by permitting multiple truth values from certain semirings. Evaluating the fixed-point formula that defines the winning region in a given game in an appropriate semiring of polynomials provides not only the Boolean information on who wins, but also tells us how they win and which strategies they might use. This is well-understood for reachability games, where the winning region is definable as a least fixed point. The case of B\"uchi games is of special interest, not only due to their practical importance, but also because it is the simplest case where the fixed-point definition involves a genuine alternation of a greatest and a least fixed point. We show that, in a precise sense, semiring semantics provide information about all absorption-dominant strategies -- strategies that win with minimal effort, and we discuss how these relate to positional and the more general persistent strategies. This information enables applications such as game synthesis or determining minimal modifications to the game needed to change its outcome. Lastly, we discuss limitations of our approach and present questions that cannot be immediately answered by semiring semantics.


title: Partial Wasserstein and Maximum Mean Discrepancy distances for bridging the gap between outlier detection and drift detection

abstract: With the rise of machine learning and deep learning based applications in practice, monitoring, i.e. verifying that these operate within specification, has become an important practical problem. An important aspect of this monitoring is to check whether the inputs (or intermediates) have strayed from the distribution they were validated for, which can void the performance assurances obtained during testing. There are two common approaches for this. The, perhaps, more classical one is outlier detection or novelty detection, where, for a single input we ask whether it is an outlier, i.e. exceedingly unlikely to have originated from a reference distribution. The second, perhaps more recent approach, is to consider a larger number of inputs and compare its distribution to a reference distribution (e.g. sampled during testing). This is done under the label drift detection. In this work, we bridge the gap between outlier detection and drift detection through comparing a given number of inputs to an automatically chosen part of the reference distribution.


title: InFlow: Robust outlier detection utilizing Normalizing Flows

abstract: Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inputs as they directly encode the local features of the input representations in their latent space. In this paper, we solve this overconfidence issue of normalizing flows by demonstrating that flows, if extended by an attention mechanism, can reliably detect outliers including adversarial attacks. Our approach does not require outlier data for training and we showcase the efficiency of our method for OOD detection by reporting state-of-the-art performance in diverse experimental settings. Code available at https://github.com/ComputationalRadiationPhysics/InFlow .


title: rSoccer: A Framework for Studying Reinforcement Learning in Small and Very Small Size Robot Soccer

abstract: Reinforcement learning is an active research area with a vast number of applications in robotics, and the RoboCup competition is an interesting environment for studying and evaluating reinforcement learning methods. A known difficulty in applying reinforcement learning to robotics is the high number of experience samples required, being the use of simulated environments for training the agents followed by transfer learning to real-world (sim-to-real) a viable path. This article introduces an open-source simulator for the IEEE Very Small Size Soccer and the Small Size League optimized for reinforcement learning experiments. We also propose a framework for creating OpenAI Gym environments with a set of benchmarks tasks for evaluating single-agent and multi-agent robot soccer skills. We then demonstrate the learning capabilities of two state-of-the-art reinforcement learning methods as well as their limitations in certain scenarios introduced in this framework. We believe this will make it easier for more teams to compete in these categories using end-to-end reinforcement learning approaches and further develop this research area.


title: Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speech

abstract: Whilst recent neural text-to-speech (TTS) approaches produce high-quality speech, they typically require a large amount of recordings from the target speaker. In previous work, a 3-step method was proposed to generate high-quality TTS while greatly reducing the amount of data required for training. However, we have observed a ceiling effect in the level of naturalness achievable for highly expressive voices when using this approach. In this paper, we present a method for building highly expressive TTS voices with as little as 15 minutes of speech data from the target speaker. Compared to the current state-of-the-art approach, our proposed improvements close the gap to recordings by 23.3% for naturalness of speech and by 16.3% for speaker similarity. Further, we match the naturalness and speaker similarity of a Tacotron2-based full-data (~10 hours) model using only 15 minutes of target speaker data, whereas with 30 minutes or more, we significantly outperform it. The following improvements are proposed: 1) changing from an autoregressive, attention-based TTS model to a non-autoregressive model replacing attention with an external duration model and 2) an additional Conditional Generative Adversarial Network (cGAN) based fine-tuning step.


title: Robust optical frequency transfer in a noisy urban fiber network

abstract: Optical fibers have been recognized as one of the most promising host material for high phase coherence optical frequency transfer over thousands of kilometers. In the pioneering work, the active phase noise cancellation (ANC) technique has been widely used for suppressing the fiber phase noise introduced by the environmental perturbations, in which an ideal phase detector with high resolution and unlimited detection range is needed to extract the fiber phase noise, in particular for noisy fiber links. We demonstrate the passive phase noise cancellation (PNC) technique without the need of phase detector could be preferable for noisy fiber links. To avoid the effect of the radio frequency (RF) from the time base at the local site in the conventional active or passive phase noise cancellation techniques, here we introduce a fiber-pigtailed acousto-optic modulator (AOM) with two diffraction order outputs (0 and +1 order) with properly allocating the AOM-driving frequencies allowing to cancel the time base effect. Using this technique, we demonstrate transfer of coherent light through a 260 km noisy urban fiber link. The results show the effect of the RF reference can be successfully removed. After being passively compensated, {we demonstrate a fractional frequency instability of $4.9\times10^{-14}$ at the integration time of 1 s and scales down to $10^{-20}$ level at 10,000 s in terms of modified Allan deviation over the 260 km noisy urban fiber link}. The frequency uncertainty of the retrieved light after transferring through this noise-compensated fiber link relative to that of the input light achieves $(0.41\pm4.7)\times10^{-18}$. The proposed technique opens a way to a broad distribution of an ultrastable frequency reference with high coherence without any effects coming from the RF reference and enables a wide range of applications beyond metrology over fiber networks.


title: A deep learning approach to resonant light transmission through single subwavelength apertures

abstract: Resonant transmission of light is a surface-wave assisted phenomenon that enables funneling light through subwavelength apertures milled in otherwise opaque metallic screens. In this work, we introduce a deep learning approach to efficiently compute and design the optical response of a single subwavelength slit perforated in a metallic screen and surrounded by periodic arrangements of indentations. First, we show that a semi-analytical framework based on a coupled-mode theory formalism is a robust and efficient method to generate the large training datasets required in the proposed approach. Second, we discuss how simple, densely connected artificial neural networks can accurately learn the mapping from the geometrical parameters defining the topology of the system to its corresponding transmission spectrum. Finally, we report on a deep learning tandem architecture able to perform inverse design tasks for the considered class of systems. We expect this work to stimulate further work on the application of deep learning to the analysis of light-matter interaction in nanostructured metallic films.


title: Independently reconfigurable internal loss and resonance-shift in an interferometer-embedded optical cavity

abstract: Optical cavities find diverse uses in lasers, frequency combs, optomechanics, and optical signal processors. Complete reconfigurability of the resonant frequency as well as the loss enables development of generic field programmable cavities for achieving the desired performance in these applications. Conventional reconfigurable cavities are generally limited to specific material platforms or specific optical tuning methods and require sophisticated fabrication. Furthermore, the tuning of the loss is coupled to the resonance-shift in the cavity. We propose and demonstrate a simple and generic interferometer in a cavity structure that enables quasiperiodic modification of the internal cavity loss and the cavity resonance to reconfigure the Q-factor, transmission characteristics, and group delay of the hybrid cavity, with simple tuning of the optical phase in the interferometer. We also demonstrate methods to decouple the tuning of the loss from the resonance-shift, that enables resonance-locked reconfigurability. This structure also enables resonance-shift to both shorter and longer wavelengths using the same phase-tuning technique, which is challenging to achieve in conventional reconfigurable cavities. These devices can be implemented in any guided-wave platform (on-chip or fiber-optic) with potential applications in programmable photonics and reconfigurable optomechanics.


title: Long-term Cross Adversarial Training: A Robust Meta-learning Method for Few-shot Classification Tasks

abstract: Meta-learning model can quickly adapt to new tasks using few-shot labeled data. However, despite achieving good generalization on few-shot classification tasks, it is still challenging to improve the adversarial robustness of the meta-learning model in few-shot learning. Although adversarial training (AT) methods such as Adversarial Query (AQ) can improve the adversarially robust performance of meta-learning models, AT is still computationally expensive training. On the other hand, meta-learning models trained with AT will drop significant accuracy on the original clean images. This paper proposed a meta-learning method on the adversarially robust neural network called Long-term Cross Adversarial Training (LCAT). LCAT will update meta-learning model parameters cross along the natural and adversarial sample distribution direction with long-term to improve both adversarial and clean few-shot classification accuracy. Due to cross-adversarial training, LCAT only needs half of the adversarial training epoch than AQ, resulting in a low adversarial training computation. Experiment results show that LCAT achieves superior performance both on the clean and adversarial few-shot classification accuracy than SOTA adversarial training methods for meta-learning models.


title: Recurrent Neural Network from Adder's Perspective: Carry-lookahead RNN

abstract: The recurrent network architecture is a widely used model in sequence modeling, but its serial dependency hinders the computation parallelization, which makes the operation inefficient. The same problem was encountered in serial adder at the early stage of digital electronics. In this paper, we discuss the similarities between recurrent neural network (RNN) and serial adder. Inspired by carry-lookahead adder, we introduce carry-lookahead module to RNN, which makes it possible for RNN to run in parallel. Then, we design the method of parallel RNN computation, and finally Carry-lookahead RNN (CL-RNN) is proposed. CL-RNN takes advantages in parallelism and flexible receptive field. Through a comprehensive set of tests, we verify that CL-RNN can perform better than existing typical RNNs in sequence modeling tasks which are specially designed for RNNs.


title: Attention Toward Neighbors: A Context Aware Framework for High Resolution Image Segmentation

abstract: High-resolution image segmentation remains challenging and error-prone due to the enormous size of intermediate feature maps. Conventional methods avoid this problem by using patch based approaches where each patch is segmented independently. However, independent patch segmentation induces errors, particularly at the patch boundary due to the lack of contextual information in very high-resolution images where the patch size is much smaller compared to the full image. To overcome these limitations, in this paper, we propose a novel framework to segment a particular patch by incorporating contextual information from its neighboring patches. This allows the segmentation network to see the target patch with a wider field of view without the need of larger feature maps. Comparative analysis from a number of experiments shows that our proposed framework is able to segment high resolution images with significantly improved mean Intersection over Union and overall accuracy.


title: Compass-free migratory navigation

abstract: How migratory birds can find the right way in navigating over thousand miles is an intriguing question, which much interested researchers in both fields of biology and physics for centuries. There several putative proposals that sound intuitively plausible all remain contested so far because those hypothesis-models of magnetoreceptor to sense geomagnetic field need either extremely high sensitivity or humankind-like intelligence to guide. Here we explore theoretically that the birds can navigate to their destination through an entirely new scenario to sense the geomagnetic field. Our proposal is based on separate peaks of the resonance-fluorescence spectrum of a four-level system derived from the ferric sulfide cluster which exists in a protein complex (Drosophila CG8198) of migratory birds. As the separation of spectral peaks contains information about geomagnetic field at both current location and birthland, the change of such separation cues the bird to choose a right direction to move and double-resonance emerges once arrived the destination. Our theoretical mechanism can explain previous experiments on the disorientation of migratory birds caused by oscillating magnetic field naturally and more precisely. This work provides insight to explain migratory navigation and motivates possible manmade practical devices.

categories: physics.bio-ph cond-mat.mtrl-sci physics.optics quant-ph


title: Two-step nilpotent Leibniz algebras

abstract: In this paper we give a complete classification of two-step nilpotent Leibniz algebras in terms of Kronecker modules associated with pairs of bilinear forms. In particular, we describe the complex and the real case of the indecomposable Heisenberg Leibniz algebras as a generalization of the classical $(2n+1)-$dimensional Heisenberg Lie algebra $\mathfrak{h}_{2n+1}$. Then we use the Leibniz algebras - Lie local racks correspondence proposed by S. Covez to show that nilpotent real Leibniz algebras have always a global integration. As an application, we integrate the indecomposable nilpotent real Leibniz algebras with one-dimensional commutator ideal. We also show that every Lie quandle integrating a Leibniz algebra is induced by the conjugation of a Lie group and the Leibniz algebra is the Lie algebra of that Lie group.


title: Neural Networks for Dengue Prediction: A Systematic Review

abstract: Due to a lack of treatments and universal vaccine, early forecasts of Dengue are an important tool for disease control. Neural networks are powerful predictive models that have made contributions to many areas of public health. In this systematic review, we provide an introduction to the neural networks relevant to Dengue forecasting and review their applications in the literature. The objective is to help inform model design for future work. Following the PRISMA guidelines, we conduct a systematic search of studies that use neural networks to forecast Dengue in human populations. We summarize the relative performance of neural networks and comparator models, model architectures and hyper-parameters, as well as choices of input features. Nineteen papers were included. Most studies implement shallow neural networks using historical Dengue incidence and meteorological input features. Prediction horizons tend to be short. Building on the strengths of neural networks, most studies use granular observations at the city or sub-national level. Performance of neural networks relative to comparators such as Support Vector Machines varies across study contexts. The studies suggest that neural networks can provide good predictions of Dengue and should be included in the set of candidate models. The use of convolutional, recurrent, or deep networks is relatively unexplored but offers promising avenues for further research, as does the use of a broader set of input features such as social media or mobile phone data.


title: Possible Relations between Brightest Central Galaxies and Their Host Galaxies Clusters and Groups

abstract: The r-band of the Sloan Digital Sky Survey (SDSS) for 17,924 brightest cluster galaxies (BCGs) in clusters and groups within 0.02 z 0.20 are used to study possible environmental relations affecting the nature of these galaxies. We find a correlation between BCGs physical properties (the effective radius (Re ), absolute magnitude and central velocity dispersion ({\sigma}0 )) and their host groups and clusters velocity dispersion ({\sigma}cl ). This type of relations suggests that the most massive groups or clusters host larger central galaxies. On the other hand, the {\sigma}0 /{\sigma}cl ratio as a function of {\sigma}cl is consistent with [10].


title: Near-Field Terahertz Nanoscopy of Coplanar Microwave Resonators

abstract: Superconducting quantum circuits are one of the leading quantum computing platforms. To advance superconducting quantum computing to a point of practical importance, it is critical to identify and address material imperfections that lead to decoherence. Here, we use terahertz Scanning Near-field Optical Microscopy (SNOM) to probe the local dielectric properties and carrier concentrations of wet-etched aluminum resonators on silicon, one of the most characteristic components of the superconducting quantum processors. Using a recently developed vector calibration technique, we extract the THz permittivity from spectroscopy in proximity to the microwave feedline. Fitting the extracted permittivity to the Drude model, we find that silicon in the etched channel has a carrier concentration greater than buffer oxide etched silicon and we explore post-processing methods to reduce the carrier concentrations. Our results show that near-field THz investigations can be applied to quantitatively evaluate and identify potential loss channels in quantum devices.


title: Collisional-radiative non-equilibrium impurity treatment for JOREK simulations

abstract: A collisional-radiative non-equilibrium impurity treatment for JOREK 3D nonlinear magneto-hydrodynamic (MHD) simulations has been developed. The impurities are represented by super-particles flowing along the fluid velocity field lines, while ionizing and recombining independently according to ADAS data and local fluid density and temperature. The non-equilibrium impurity contributions are then projected back to the fluid field for self-consistent time evolution. A 2D test case is used to compare the new non-equilibrium impurity model against previous Coronal Equilibrium (CE) impurity treatment, as well as to compare the non-equilibrium impurity behavior between the single and the two temperature model. Further, we conduct benchmark with previously published coronal non-equilibrium results by other 3D nonlinear MHD codes such as M3D-C1 and NIMROD. The new non-equilibrium treatment is shown to successfully capture the early phase cooling by weakly ionized impurities which the CE model missed. The benchmarks with M3D-C1 and NIMROD show general agreement in both the integrated quantities and the 2D profile evolution, despite the difference in the atomic model used. The above comparison and benchmark cases demonstrate the capability of the non-equilibrium impurity model for JOREK, paving the way for more sophisticated 3D non-linear Massive Material Injection (MMI) simulations which have important applications in disruption mitigation studies.


title: Unitary $p$-wave Fermi gas in one dimension

abstract: We elucidate universal many-body properties of a one-dimensional, two-component ultracold Fermi gas near the $p$-wave Feshbach resonance. The low-energy scattering in this system can be characterized by two parameters, that is, $p$-wave scattering length and effective range. At the unitarity limit where the $p$-wave scattering length diverges and the effective range is reduced to zero without conflicting with the causality bound, the system obeys universal thermodynamics as observed in a unitary Fermi gas with contact $s$-wave interaction in three dimensions. It is in contrast to a Fermi gas with the $p$-wave resonance in three dimensions in which the effective range is inevitably finite. We present the universal equation of state in this unitary $p$-wave Fermi gas within the many-body $T$-matrix approach as well as the virial expansion method. Moreover, we examine the single-particle spectral function in the high-density regime where the virial expansion is no longer valid. On the basis of the Hartree-like self-energy shift at the divergent scattering length, we conjecture that the equivalence of the Bertsch parameter across spatial dimensions holds even for a one-dimensional unitary $p$-wave Fermi gas.

categories: cond-mat.quant-gas cond-mat.str-el cond-mat.supr-con nucl-th


title: $tW$ and $tZ'$ production at hadron colliders

abstract: We present theoretical results with soft-gluon corrections for two separate processes: (1) the production of a single top quark in association with a $W$ boson in the Standard Model; and (2) the production of a single top quark in association with a heavy $Z'$ boson in new physics models with or without anomalous couplings. We show that the higher-order corrections from soft-gluon emission are dominant for a wide range of collider energies. Results are shown for the total cross sections and top-quark transverse-momentum and rapidity distributions for $tW$ and $tZ'$ production at LHC and future collider energies up to 100 TeV. The uncertainties from scale dependence and parton distribution functions are also analyzed.


title: Towards practical and error-robust quantum position verification

abstract: Loss of inputs can be detrimental to the security of quantum position verification (QPV) protocols, as it may allow attackers to not answer on all played rounds, but only on those they perform well on. In this work, we study \textit{loss-tolerant} QPV protocols. We propose a new fully loss-tolerant protocol QPV$_{\textsf{SWAP}}$, based on the SWAP test, with several desirable properties. The task of the protocol, which could be implemented using only a single beam splitter and two detectors, is to estimate the overlap between two input states. By formulating possible attacks as a semi-definite program (SDP), we prove full loss tolerance against unentangled attackers restricted to local operations and classical communication, and show that the attack probability decays exponentially under parallel repetition of rounds. We show that the protocol remains secure even if unentangled attackers are allowed to quantum communicate, making our protocol the first fully loss-tolerant protocol with this property. A detailed analysis under experimental conditions is conducted, showing that QPV$_{\textsf{SWAP}}$ remains fairly robust against equipment errors. We identify a necessary condition for security with errors and simulate one instance of our protocol with currently realistic experimental parameters, gathering that an attack success probability of $\leq10^{-6}$ can be achieved by collecting just a few hundred conclusive protocol rounds.


title: Information Bottleneck: Exact Analysis of (Quantized) Neural Networks

abstract: The information bottleneck (IB) principle has been suggested as a way to analyze deep neural networks. The learning dynamics are studied by inspecting the mutual information (MI) between the hidden layers and the input and output. Notably, separate fitting and compression phases during training have been reported. This led to some controversy including claims that the observations are not reproducible and strongly dependent on the type of activation function used as well as on the way the MI is estimated. Our study confirms that different ways of binning when computing the MI lead to qualitatively different results, either supporting or refusing IB conjectures. To resolve the controversy, we study the IB principle in settings where MI is non-trivial and can be computed exactly. We monitor the dynamics of quantized neural networks, that is, we discretize the whole deep learning system so that no approximation is required when computing the MI. This allows us to quantify the information flow without measurement errors. In this setting, we observed a fitting phase for all layers and a compression phase for the output layer in all experiments; the compression in the hidden layers was dependent on the type of activation function. Our study shows that the initial IB results were not artifacts of binning when computing the MI. However, the critical claim that the compression phase may not be observed for some networks also holds true.


title: Understanding the Dyer-Roeder approximation as a consequence of local cancellations of projected shear and expansion rate fluctuations

abstract: It is shown with several concrete examples that the Dyer-Roeder approximation is valid in spacetimes which fulfill the condition that fluctuations in the expansion rate along a light ray locally cancels with the shear contribution to the redshift. This is the case for standard cosmological scenarios including perturbed FLRW spacetimes, N-body simulations and Swiss-cheese models. With another concrete example it is then illustrated that it is possible to construct statistically homogeneous and effectively statistically isotropic cosmological models which do not fulfill the condition. In this case, the Dyer-Roeder approximation is invalid. Instead, the mean redshift-distance relation can be described using a relation based on the spatial averages of the transparent part of the spacetime.


title: Speech is Silver, Silence is Golden: What do ASVspoof-trained Models Really Learn?

abstract: We present our analysis of a significant data artifact in the official 2019/2021 ASVspoof Challenge Dataset. We identify an uneven distribution of silence duration in the training and test splits, which tends to correlate with the target prediction label. Bonafide instances tend to have significantly longer leading and trailing silences than spoofed instances. In this paper, we explore this phenomenon and its impact in depth. We compare several types of models trained on a) only the duration of the leading silence and b) only on the duration of leading and trailing silence. Results show that models trained on only the duration of the leading silence perform particularly well, and achieve up to 85% percent accuracy and an equal error rate (EER) of 15.1%. At the same time, we observe that trimming silence during pre-processing and then training established antispoofing models using signal-based features leads to comparatively worse performance. In that case, EER increases from 3.6% (with silence) to 15.5% (trimmed silence). Our findings suggest that previous work may, in part, have inadvertently learned thespoof/bonafide distinction by relying on the duration of silence as it appears in the official challenge dataset. We discuss the potential consequences that this has for interpreting system scores in the challenge and discuss how the ASV community may further consider this issue.


title: Numerical influence of ReLU'(0) on backpropagation

abstract: In theory, the choice of ReLU(0) in [0, 1] for a neural network has a negligible influence both on backpropagation and training. Yet, in the real world, 32 bits default precision combined with the size of deep learning problems makes it a hyperparameter of training methods. We investigate the importance of the value of ReLU'(0) for several precision levels (16, 32, 64 bits), on various networks (fully connected, VGG, ResNet) and datasets (MNIST, CIFAR10, SVHN, ImageNet). We observe considerable variations of backpropagation outputs which occur around half of the time in 32 bits precision. The effect disappears with double precision, while it is systematic at 16 bits. For vanilla SGD training, the choice ReLU'(0) = 0 seems to be the most efficient. For our experiments on ImageNet the gain in test accuracy over ReLU'(0) = 1 was more than 10 points (two runs). We also evidence that reconditioning approaches as batch-norm or ADAM tend to buffer the influence of ReLU'(0)'s value. Overall, the message we convey is that algorithmic differentiation of nonsmooth problems potentially hides parameters that could be tuned advantageously.


title: L'Apprentissage Automatique dans la planification et le contr{\^o}le de la production : un {\'e}tat de l'art

abstract: Proper Production Planning and Control (PPC) is capital to have an edge over competitors, reduce costs and respect delivery dates. With regard to PPC, Machine Learning (ML) provides new opportunities to make intelligent decisions based on data. Therefore, this communication provides an initial systematic review of publications on ML applied in PPC. The research objective of this study is twofold: firstly, it aims to identify techniques and tools allowing to apply ML in PPC, and secondly, it reviews the characteristics of Industry 4.0 (I4.0) in recent research papers. Concerning the second objective, seven characteristics of I4.0 are used in the analysis framework, from which two of them are proposed by the authors. Additionally, the addressed domains of ML-aided PPC in scientific literature are identified. Finally, results are analyzed and gaps that may motivate further research are highlighted.


title: Continuous-Time Deep Glioma Growth Models

abstract: The ability to estimate how a tumor might evolve in the future could have tremendous clinical benefits, from improved treatment decisions to better dose distribution in radiation therapy. Recent work has approached the glioma growth modeling problem via deep learning and variational inference, thus learning growth dynamics entirely from a real patient data distribution. So far, this approach was constrained to predefined image acquisition intervals and sequences of fixed length, which limits its applicability in more realistic scenarios. We overcome these limitations by extending Neural Processes, a class of conditional generative models for stochastic time series, with a hierarchical multi-scale representation encoding including a spatio-temporal attention mechanism. The result is a learned growth model that can be conditioned on an arbitrary number of observations, and that can produce a distribution of temporally consistent growth trajectories on a continuous time axis. On a dataset of 379 patients, the approach successfully captures both global and finer-grained variations in the images, exhibiting superior performance compared to other learned growth models.