title: On Second-order Optimization Methods for Federated Learning

abstract: We consider federated learning (FL), where the training data is distributed across a large number of clients. The standard optimization method in this setting is Federated Averaging (FedAvg), which performs multiple local first-order optimization steps between communication rounds. In this work, we evaluate the performance of several second-order distributed methods with local steps in the FL setting which promise to have favorable convergence properties. We (i) show that FedAvg performs surprisingly well against its second-order competitors when evaluated under fair metrics (equal amount of local computations)-in contrast to the results of previous work. Based on our numerical study, we propose (ii) a novel variant that uses second-order local information for updates and a global line search to counteract the resulting local specificity.


title: Efimov-like physics in fraction-dimensional Bose systems with three-body interaction

abstract: A few-body properties of spinless Bose particles interacting via the contact three-body potential in geometries with fractional dimensions $1<d<2$ are considered. In the four-body sector at three-body resonance we predict the existence of infinite tower of the Efimov bound states, and a similar behavior is found in the five-body problem. It is shown that a ratio of the high-energy levels in these two sectors is a universal constant. The consequences of emergence of the Efimov physics on the many-body behavior are briefly discussed.


title: Magnetic dipole moments of the $T_{cc}^+$ and $Z_V^{++}$ tetraquark states

abstract: Inspired by the observation of the doubly charmed state $T_{cc}$ and following theoretical studies on its spectroscopic parameters, we investigate its magnetic dipole moment assigning it the quantum numbers $J^P=1^+$ and both the compact diquark-antidiquark and molecular structures in the framework of the light-cone QCD. We also calculate the magnetic dipole moment of the theoretically predicted singly charmed state, $Z_V^{++}$, with two units of electric charge and the quantum numbers $J^P=1^-$ in diquark-antidiquark picture. The numerical results are obtained as $\mu_{T_{cc}^+-Di} =0.66^{+0.34}_{-0.23}~\mu_N$, $ \mu_{T_{cc}^+-Mol} =0.43^{+0.23}_{-0.22}~\mu_N $ and $\mu_{Z_{V}^{++}} =3.35^{+0.89}_{-0.73} ~\mu_N$. These results may be checked via other phenomenological approaches. The obtained results may be useful in exact determinations of the natures of these states.


title: Polynomial Invariant of Molecular Circuit Topology

abstract: The topological framework of circuit topology has recently been introduced to complement knot theory and to help in understanding the physics of molecular folding. Naturally evolved linear molecular chains, such as proteins and nucleic acids, often fold into 3D conformations with critical chain entanglements and local or global structural symmetries stabilised by formation contacts between different parts of the chain. Circuit topology captures the arrangements of intra-chain contacts within a given folded linear chain and allows for the classification and comparison of chains. Contacts keep chain segments in physical proximity and can be either mechanically hard attachments or soft entanglements that constrain a physical chain. Contrary to knot theory, which offers many established knot invariants, circuit invariants are just being developed. Here, we present polynomial invariants that are both efficient and sufficiently powerful to deal with any combination of soft and hard contacts. A computer implementation and table of chains with up to three contacts is also provided.


title: LoRa-RL: Deep Reinforcement Learning for Resource Management in Hybrid Energy LoRa Wireless Networks

abstract: LoRa wireless networks are considered as a key enabling technology for next generation internet of things (IoT) systems. New IoT deployments (e.g., smart city scenarios) can have thousands of devices per square kilometer leading to huge amount of power consumption to provide connectivity. In this paper, we investigate green LoRa wireless networks powered by a hybrid of the grid and renewable energy sources, which can benefit from harvested energy while dealing with the intermittent supply. This paper proposes resource management schemes of the limited number of channels and spreading factors (SFs) with the objective of improving the LoRa gateway energy efficiency. First, the problem of grid power consumption minimization while satisfying the system's quality of service demands is formulated. Specifically, both scenarios the uncorrelated and time-correlated channels are investigated. The optimal resource management problem is solved by decoupling the formulated problem into two sub-problems: channel and SF assignment problem and energy management problem. Since the optimal solution is obtained with high complexity, online resource management heuristic algorithms that minimize the grid energy consumption are proposed. Finally, taking into account the channel and energy correlation, adaptable resource management schemes based on Reinforcement Learning (RL), are developed. Simulations results show that the proposed resource management schemes offer efficient use of renewable energy in LoRa wireless networks.


title: Some minimization problems for mean field models with competing forces

abstract: We review recent results on three families of minimization problems, defined on subsets of nonnegative functions with fixed integral. The competition between attractive and repulsive forces leads to transitions between parameter regimes, where minimizers exist and where they do not. The problems considered are generalized liquid drop models, swarming models and generalized Keller-Segel models.


title: Less is More: Lighter and Faster Deep Neural Architecture for Tomato Leaf Disease Classification

abstract: To ensure global food security and the overall profit of stakeholders, the importance of correctly detecting and classifying plant diseases is paramount. In this connection, the emergence of deep learning-based image classification has introduced a substantial number of solutions. However, the applicability of these solutions in low-end devices requires fast, accurate, and computationally inexpensive systems. This work proposes a lightweight transfer learning-based approach for detecting diseases from tomato leaves. It utilizes an effective preprocessing method to enhance the leaf images with illumination correction for improved classification. Our system extracts features using a combined model consisting of a pretrained MobileNetV2 architecture and a classifier network for effective prediction. Traditional augmentation approaches are replaced by runtime augmentation to avoid data leakage and address the class imbalance issue. Evaluation on tomato leaf images from the PlantVillage dataset shows that the proposed architecture achieves 99.30% accuracy with a model size of 9.60MB and 4.87M floating-point operations, making it a suitable choice for real-life applications in low-end devices. Our codes and models are available at https://github.com/redwankarimsony/project-tomato.


title: Effects of gravitational lensing on neutrino oscillation in $ \gamma $-spacetime

abstract: We study the effects of gravitational lensing on neutrino oscillations in the $\gamma$-spacetime which describes a static, axially-symmetric and asymptotically flat solution of the Einstein's field equations in vacuum. Using the quantum-mechanical treatment for relativistic neutrinos, we calculate the phase of neutrino oscillations in this spacetime by considering both radial and non-radial propagation. We show the dependence of the oscillation probability on the absolute neutrino masses, which in the two-flavor case also depends upon the sign of mass squared difference, in sharp contrast with the well-known results of vacuum oscillation in flat spacetime. We also show the effects of the deformation parameter $\gamma$ on neutrino oscillations and reproduce previously known results for the Schwarzschild metric. We then extend these to a more realistic three flavors neutrino scenario and study the effects of the parameter $\gamma$ and the lightest neutrino mass while using best fit values of neutrino oscillation parameters.


title: Byzantine-Robust Federated Learning via Credibility Assessment on Non-IID Data

abstract: Federated learning is a novel framework that enables resource-constrained edge devices to jointly learn a model, which solves the problem of data protection and data islands. However, standard federated learning is vulnerable to Byzantine attacks, which will cause the global model to be manipulated by the attacker or fail to converge. On non-iid data, the current methods are not effective in defensing against Byzantine attacks. In this paper, we propose a Byzantine-robust framework for federated learning via credibility assessment on non-iid data (BRCA). Credibility assessment is designed to detect Byzantine attacks by combing adaptive anomaly detection model and data verification. Specially, an adaptive mechanism is incorporated into the anomaly detection model for the training and prediction of the model. Simultaneously, a unified update algorithm is given to guarantee that the global model has a consistent direction. On non-iid data, our experiments demonstrate that the BRCA is more robust to Byzantine attacks compared with conventional methods


title: On optimal cloaking-by-mapping transformations

abstract: A central ingredient of cloaking-by-mapping is the diffeomorphisn which transforms an annulus with a small hole into an annulus with a finite size hole, while being the identity on the outer boundary of the annulus. The resulting meta-material is anisotropic, which makes it difficult to manufacture. The problem of minimizing anisotropy among radial transformations has been studied in [4]. In this work, as in [4], we formulate the problem of minimizing anisotropy as an energy minimization problem. Our main goal is to provide strong evidence for the conjecture that for cloaks with circular boundaries, non-radial transformations do not lead to lower degree of anisotropy. In the final section, we consider cloaks with non-circular boundaries and show that in this case, non-radial cloaks may be advantageous, when it comes to minimizing anisotropy.


title: Click-Through Rate Prediction with Multi-Modal Hypergraphs

abstract: Advertising is critical to many online e-commerce platforms such as e-Bay and Amazon. One of the important signals that these platforms rely upon is the click-through rate (CTR) prediction. The recent popularity of multi-modal sharing platforms such as TikTok has led to an increased interest in online micro-videos. It is, therefore, useful to consider micro-videos to help a merchant target micro-video advertising better and find users' favourites to enhance user experience. Existing works on CTR prediction largely exploit unimodal content to learn item representations. A relatively minimal effort has been made to leverage multi-modal information exchange among users and items. We propose a model to exploit the temporal user-item interactions to guide the representation learning with multi-modal features, and further predict the user click rate of the micro-video item. We design a Hypergraph Click-Through Rate prediction framework (HyperCTR) built upon the hyperedge notion of hypergraph neural networks, which can yield modal-specific representations of users and micro-videos to better capture user preferences. We construct a time-aware user-item bipartite network with multi-modal information and enrich the representation of each user and item with the generated interests-based user hypergraph and item hypergraph. Through extensive experiments on three public datasets, we demonstrate that our proposed model significantly outperforms various state-of-the-art methods.


title: Stability of a Composite Wave of Two Seperate Strong Viscous Shock Waves for 1-D Isentropic Navier-Stokes System

abstract: In this paper, the large time behavior of solutions of 1-D isentropic Navier-Stokes system is investigated. It is shown that a composite wave consisting of two viscous shock waves is stable for the Cauchy problem provided that the two waves are initially far away from each other. Moreover the strengths of two waves could be arbitrarily large.


title: Multi-frequency MRE for elasticity quantitation and optimal tissue discrimination: a two-platform liver fibrosis mimicking phantom study

abstract: In the framework of algebraic inversion, Magnetic Resonance Elastography (MRE) repeatability, reproducibility and robustness were evaluated on extracted shear velocities (or elastic moduli). The same excitation system was implemented at two sites equipped with clinical MR scanners of 1.5 T and 3 T. A set of four elastic, isotropic, homogeneous calibrated phantoms of distinct elasticity representing the spectrum of liver fibrosis severity was mechanically characterized. The repeatability of the measurements and the reproducibility between the two platforms were found to be excellent with mean coefficients of variations of 1.62% for the shear velocity mean values and 1.95% for the associated standard deviations. MRE velocities were robust to the amplitude and pattern variations of the displacement field with virtually no difference between outcomes from both magnets at identical excitation frequencies even when the displacement field amplitude was 6 times smaller. However, MRE outcomes were very sensitive to the number of voxels per wavelength, s, of the recorded displacement field, with relative biases reaching 62% and precision losing up to a factor 23.5. For both magnetic field strengths, MRE accuracy and precision were largely degraded outside of established conditions of validity ($6 \lesssim s \lesssim 9$) resulting in estimated shear velocity values not significantly different between phantoms of increasing elasticity. When fulfilling the spatial sampling conditions, either prospectively in the acquisition or retrospectively before the reconstruction, MRE produced quantitative measurements that allowed to unambiguously discriminate, with infinitesimal p-values, between the phantoms mimicking increasing severity of liver fibrosis.


title: Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization

abstract: Multimodal abstractive summarization (MAS) models that summarize videos (vision modality) and their corresponding transcripts (text modality) are able to extract the essential information from massive multimodal data on the Internet. Recently, large-scale generative pre-trained language models (GPLMs) have been shown to be effective in text generation tasks. However, existing MAS models cannot leverage GPLMs' powerful generation ability. To fill this research gap, we aim to study two research questions: 1) how to inject visual information into GPLMs without hurting their generation ability; and 2) where is the optimal place in GPLMs to inject the visual information? In this paper, we present a simple yet effective method to construct vision guided (VG) GPLMs for the MAS task using attention-based add-on layers to incorporate visual information while maintaining their original text generation ability. Results show that our best model significantly surpasses the prior state-of-the-art model by 5.7 ROUGE-1, 5.3 ROUGE-2, and 5.1 ROUGE-L scores on the How2 dataset, and our visual guidance method contributes 83.6% of the overall improvement. Furthermore, we conduct thorough ablation studies to analyze the effectiveness of various modality fusion methods and fusion locations.


title: Low-cycle fatigue of a nickel-based superalloy at high temperature: Simplified micromechanical modelling

abstract: This work is focused on the micromechanical modelling of the low cycle fatigue of the nickel based $\gamma/\gamma'$ superalloy AM1 at high temperature. The nature of the activated slip systems in the different types of channels of the $\gamma$ phase is analysed, taking into account the combined effects of the applied and internal stresses. The latter are split into two contributions, misfit stresses and compatibility stresses between the elastic $\gamma'$ phase and the elasto-plastic $\gamma$ phase, which are estimated within a simplified composite approach. Internal stresses may induce slip activity and/or be relaxed by it, which results in a complex sequence of slip activation events in the different channels under increasing applied stress. The consideration of these effects leads to a prediction of the nature and distribution of the active slip systems within the channels in [001] tension, compression and during low cycle fatigue. The resulting microstructural behaviour and its consequences regarding the anisotropic nature of the coalescence of the $\gamma'$ precipitates are discussed with respect to the available experimental data.


title: Eliminating Sentiment Bias for Aspect-Level Sentiment Classification with Unsupervised Opinion Extraction

abstract: Aspect-level sentiment classification (ALSC) aims at identifying the sentiment polarity of a specified aspect in a sentence. ALSC is a practical setting in aspect-based sentiment analysis due to no opinion term labeling needed, but it fails to interpret why a sentiment polarity is derived for the aspect. To address this problem, recent works fine-tune pre-trained Transformer encoders for ALSC to extract an aspect-centric dependency tree that can locate the opinion words. However, the induced opinion words only provide an intuitive cue far below human-level interpretability. Besides, the pre-trained encoder tends to internalize an aspect's intrinsic sentiment, causing sentiment bias and thus affecting model performance. In this paper, we propose a span-based anti-bias aspect representation learning framework. It first eliminates the sentiment bias in the aspect embedding by adversarial learning against aspects' prior sentiment. Then, it aligns the distilled opinion candidates with the aspect by span-based dependency modeling to highlight the interpretable opinion terms. Our method achieves new state-of-the-art performance on five benchmarks, with the capability of unsupervised opinion extraction.


title: Transition of a binary solution into an inhomogeneous phase

abstract: The thermodynamics of phase transitions of binary solutions into spatially inhomogeneous one-dimensional states is studied theoretically with taking into account nonlinear effects. It is shown that below the spinodal decomposition temperature there first occurs a phase stratification, and at a lower temperature, after reaching the maximum possible stratification, there occurs a second-order transition into the phase with concentration waves. The contribution of inhomogeneity to the entropy and heat capacity of phases is calculated and the phase diagram in the coordinates temperature and average concentration is constructed.


title: Positive Stochastic Collocation for the Collocated Local Volatility Model

abstract: This paper presents how to apply the stochastic collocation technique to assets that can not move below a boundary. It shows that the polynomial collocation towards a lognormal distribution does not work well. Then, the potentials issues of the related collocated local volatility model (CLV) are explored. Finally, a simple analytical expression for the Dupire local volatility derived from the option prices modelled by stochastic collocation is given.


title: On the $q$-analogue of P\'olya's Theorem

abstract: We answer a question posed by Michael Aissen in 1979 about the $q$-analogue of a classical theorem of George P\'olya (1922) on the algebraicity of (generalized) diagonals of bivariate rational power series. In particular, we prove that the answer to Aissen's question, in which he considers $q$ as a variable, is negative in general. Moreover, we show that when $q$ is a complex number, the answer is positive if and only if $q$ is a root of unity.


title: Dressed behavior of the quasiparticles lifetime in the unitary limit of two unconventional superconductors

abstract: We compare the quasiparticle lifetime behavior in the unitary limit of two unconventional superconductors dressed by non-magnetic impurity scattering to differentiate an anomalous functional behavior in its shape when the disorder concentration is changed in a triplet paired model with respect to the well behave singlet model. For singlet paired superconductors, the functional shape of the lifetime due to elastic scattering around the nodal regions does not change with the change of the disorder concentration, but for a triplet model with a tiny gap, an anomalous drop in shape is observed only when small values of disordering are added. We use a 2D tight-binding parametrization to study the reduced phase space of the first Brillouin zone, where the low energy scattering is restricted to the nodal/quasinodal regions for two irreducible representations of the crystal lattice.


title: Two-impurity Kondo effect in potassium doped single-layer p-sexiphenyl films

abstract: We show that a self-assembled phase of potassium (K) doped single-layer para-sexiphenyl (PSP) film on gold substrate is an excellent platform for studying the two-impurity Kondo model. On K-doped PSP molecules well separated from others, we find a Kondo resonance peak near EF with a Kondo temperature of about 30 K. The Kondo resonance peak splits when another K-doped PSP molecule is present in the vicinity, and the splitting gradually increases with the decreased inter-molecular distance, with no signs of phase transition. Our data demonstrate how a Kondo singlet state gradually evolves into an antiferromagnetic singlet state due to the competition between Kondo screening and antiferromagnetic RKKY coupling, as described in the two-impurity Kondo model. Intriguingly, the antiferromagnetic singlet is destroyed quickly upon increasing temperature and transforms back to a Kondo singlet well below the Kondo temperature. Our data provide a comprehensive picture and quantitative constraints on related theories and calculations of two-impurity Kondo model.


title: QSSA: An SSA-based IR for Quantum Computing

abstract: Quantum computing hardware has progressed rapidly. Simultaneously, there has been a proliferation of programming languages and program optimization tools for quantum computing. Existing quantum compilers use intermediate representations (IRs) where quantum programs are described as circuits. Such IRs fail to leverage existing work on compiler optimizations. In such IRs, it is non-trivial to statically check for physical constraints such as the no-cloning theorem, which states that qubits cannot be copied. We introduce QSSA, a novel quantum IR based on static single assignment (SSA) that enables decades of research in compiler optimizations to be applied to quantum compilation. QSSA models quantum operations as being side-effect-free. The inputs and outputs of the operation are in one-to-one correspondence; qubits cannot be created or destroyed. As a result, our IR supports a static analysis pass that verifies no-cloning at compile-time. The quantum circuit is fully encoded within the def-use chain of the IR, allowing us to leverage existing optimization passes on SSA representations such as redundancy elimination and dead-code elimination. Running our QSSA-based compiler on the QASMBench and IBM Quantum Challenge datasets, we show that our optimizations perform comparably to IBM's Qiskit quantum compiler infrastructure. QSSA allows us to represent, analyze, and transform quantum programs using the robust theory of SSA representations, bringing quantum compilation into the realm of well-understood theory and practice.


title: All order resummed leading and next-to-leading soft modes of dense QCD pressure

abstract: The cold and dense QCD equation of state (EoS) at high baryon chemical potential $\mu_B$ involves at order $\alpha^2_S$ an all-loop summation of the soft mode $m_E\sim \alpha_S^{1/2} \mu_B$ contributions. Recently, the complete soft contributions at order $\alpha^3_S$ were calculated, using the hard thermal loop (HTL) formalism. By identifying {\em massive} renormalization group (RG) properties within HTL, we resum to all orders $\alpha_S^p, p\ge 3$ the leading and next-to-leading logarithmic soft contributions. We obtain compact analytical expressions, that show visible deviations from the state-of-the art results, and noticeably reduced residual scale dependence. Our results should help to reduce uncertainties in extending the EoS in the intermediate $\mu_B$ regime, relevant in particular for the phenomenology of neutron stars.


title: Data-Driven Wind Turbine Wake Modeling via Probabilistic Machine Learning

abstract: Wind farm design primarily depends on the variability of the wind turbine wake flows to the atmospheric wind conditions, and the interaction between wakes. Physics-based models that capture the wake flow-field with high-fidelity are computationally very expensive to perform layout optimization of wind farms, and, thus, data-driven reduced order models can represent an efficient alternative for simulating wind farms. In this work, we use real-world light detection and ranging (LiDAR) measurements of wind-turbine wakes to construct predictive surrogate models using machine learning. Specifically, we first demonstrate the use of deep autoencoders to find a low-dimensional \emph{latent} space that gives a computationally tractable approximation of the wake LiDAR measurements. Then, we learn the mapping between the parameter space and the (latent space) wake flow-fields using a deep neural network. Additionally, we also demonstrate the use of a probabilistic machine learning technique, namely, Gaussian process modeling, to learn the parameter-space-latent-space mapping in addition to the epistemic and aleatoric uncertainty in the data. Finally, to cope with training large datasets, we demonstrate the use of variational Gaussian process models that provide a tractable alternative to the conventional Gaussian process models for large datasets. Furthermore, we introduce the use of active learning to adaptively build and improve a conventional Gaussian process model predictive capability. Overall, we find that our approach provides accurate approximations of the wind-turbine wake flow field that can be queried at an orders-of-magnitude cheaper cost than those generated with high-fidelity physics-based simulations.


title: The limits of multiplexing quantum and classical channels: Case study of a 2.5 GHz discrete variable quantum key distribution system

abstract: Network integration of quantum key distribution is crucial for its future widespread deployment due to the high cost of using optical fibers dedicated for the quantum channel, only. We studied the performance of a system running a simplified BB84 protocol at 2.5 GHz repetition rate, operating in the original wavelength band, short O-band, when multiplexed with communication channels in the conventional wavelength band, short C-band. Our system could successfully generate secret keys over a single-mode fiber with a length of 95.5 km and with co-propagating classical signals at a launch power of 8.9 dBm. Further, we discuss the performance of an ideal system under the same conditions, showing the limits of what is possible with a discrete variable system in the O-band. We also considered a short and lossy link with 51 km optical fiber resembling a real link in a metropolitan area network. In this scenario we could exchange a secret key with a launch power up to 16.7 dBm in the classical channels.


title: A Decoupled Uncertainty Model for MRI Segmentation Quality Estimation

abstract: Quality control (QC) of MR images is essential to ensure that downstream analyses such as segmentation can be performed successfully. Currently, QC is predominantly performed visually and subjectively, at significant time and operator cost. We aim to automate the process using a probabilistic network that estimates segmentation uncertainty through a heteroscedastic noise model, providing a measure of task-specific quality. By augmenting training images with k-space artefacts, we propose a novel CNN architecture to decouple sources of uncertainty related to the task and different k-space artefacts in a self-supervised manner. This enables the prediction of separate uncertainties for different types of data degradation. While the uncertainty predictions reflect the presence and severity of artefacts, the network provides more robust and generalisable segmentation predictions given the quality of the data. We show that models trained with artefact augmentation provide informative measures of uncertainty on both simulated artefacts and problematic real-world images identified by human raters, both qualitatively and quantitatively in the form of error bars on volume measurements. Relating artefact uncertainty to segmentation Dice scores, we observe that our uncertainty predictions provide a better estimate of MRI quality from the point of view of the task (gray matter segmentation) compared to commonly used metrics of quality including signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR), hence providing a real-time quality metric indicative of segmentation quality.


title: Levitating atmospheres around naked singularities

abstract: For a wide class of spherically symmetric naked singularities there is a sphere within which gravity is effectively repulsive. In such spacetimes accreting matter cannot reach the singularity and will instead form a levitating atmosphere, which is kept suspended by gravity alone. The density of the atmosphere has a maximum at a definite radius. In its qualitative properties the atmosphere is analogous to the recently discussed atmospheres that are supported by radiation pressure above luminous neutron stars, however for the levitating atmospheres around a naked singularity no radiation need be present.


title: Evaluation of Convolutional Neural Networks for COVID-19 Classification on Chest X-Rays

abstract: Early identification of patients with COVID-19 is essential to enable adequate treatment and to reduce the burden on the health system. The gold standard for COVID-19 detection is the use of RT-PCR tests. However, due to the high demand for tests, these can take days or even weeks in some regions of Brazil. Thus, an alternative for detecting COVID-19 is the analysis of Digital Chest X-rays (XR). Changes due to COVID-19 can be detected in XR, even in asymptomatic patients. In this context, models based on deep learning have great potential to be used as support systems for diagnosis or as screening tools. In this paper, we propose the evaluation of convolutional neural networks to identify pneumonia due to COVID-19 in XR. The proposed methodology consists of a preprocessing step of the XR, data augmentation, and classification by the convolutional architectures DenseNet121, InceptionResNetV2, InceptionV3, MovileNetV2, ResNet50, and VGG16 pre-trained with the ImageNet dataset. The obtained results demonstrate that the VGG16 architecture obtained superior performance in the classification of XR for the evaluation metrics using the methodology proposed in this article. The obtained results for our methodology demonstrate that the VGG16 architecture presented a superior performance in the classification of XR, with an Accuracy of 85.11%, Sensitivity of 85.25%, Specificity of $85.16%, F1-score of $85.03%, and an AUC of 0.9758.


title: Brain MR-Elastography in microgravity analogous conditions

abstract: The head down tilt (HDT) position is commonly used to simulate vascular and tissue fluid dynamics during spaceflights. In HDT position, the cerebral autoregulation faces difficulties to adjust the vascular tone while the cephalad fluid shifts may yield increased intracranial pressures and altered mechanical properties. Recent MRI T2 mapping in HDT position have shown fluid overpressure in the brain and resulting loss of water contents in the CSF and orbital compartments. Brain MRE was performed here in similar HDT conditions. It was sensitive enough to provide new insights on the overall mechanical response of brain tissues in microgravity analogous conditions. Summary of Main Findings/Short Synopsis Brain fluid overpressure and resulting loss of water contents in CSF and orbital compartments were confirmed by T2 mapping in head down tilt position. The overall brain mechanical response in such microgravity analogous conditions, cerebral tissue stiffening, was revealed by whole brain MRE.


title: Detection of Insider Threats using Artificial Intelligence and Visualisation

abstract: Insider threats are one of the most damaging risk factors for the IT systems and infrastructure of a company or an organization; identification of insider threats has prompted the interest of the world academic research community, with several solutions having been proposed to alleviate their potential impact. For the implementation of the experimental stage described in this study, the Convolutional Neural Network (from now on CNN) algorithm was used and implemented via the Google TensorFlow program, which was trained to identify potential threats from images produced by the available dataset. From the examination of the images that were produced and with the help of Machine Learning, the question of whether the activity of each user is classified as malicious or not for the Information System was answered.


title: Multitask Balanced and Recalibrated Network for Medical Code Prediction

abstract: Human coders assign standardized medical codes to clinical documents generated during patients' hospitalization, which is error-prone and labor-intensive. Automated medical coding approaches have been developed using machine learning methods such as deep neural networks. Nevertheless, automated medical coding is still challenging because of the imbalanced class problem, complex code association, and noise in lengthy documents. To solve these issues, we propose a novel neural network called Multitask Balanced and Recalibrated Neural Network. Significantly, the multitask learning scheme shares the relationship knowledge between different code branches to capture the code association. A recalibrated aggregation module is developed by cascading convolutional blocks to extract high-level semantic features that mitigate the impact of noise in documents. Also, the cascaded structure of the recalibrated module can benefit the learning from lengthy notes. To solve the class imbalanced problem, we deploy the focal loss to redistribute the attention of low and high-frequency medical codes. Experimental results show that our proposed model outperforms competitive baselines on a real-world clinical dataset MIMIC-III.


title: Prepared MR Elastography

abstract: By decoupling motion and spatial encoding, magnitude contrast MR Elastography could be performed for the first time at ultrashort echo times (12 $\mu$s). On the basis of a motion-sensitizing magnetization preparation, the available total magnetic moment is sensitized to the motion induced in the tissues so the information can be efficiently carried over by the MR signal magnitude when the selected imaging pulse sequence is applied. The new paradigm allows also for shorter total acquisition times as demonstrated here in a set of homogeneous and heterogeneous phantoms with up to 5-fold acceleration factors. Summary of Main Findings/Short Synopsis Magnitude contrast MR Elastography was developed on the basis of a motionsensitizing magnetization preparation to subsequently make use of any type of imaging sequence, like UTE or ZTE, to mechanically characterize tissues, otherwise inaccessible with standard MRE.


title: Asymptotic critical behavior of holographic phase transition at finite topological charge -- the spectrum of excited states becomes continuous at $T=0$

abstract: Within the framework of AdS/CFT duality, excited states of the conformal field living at the global AdS boundary of a four-dimensional spacetime Einstein gravity are investigated analytically in the probe limit where the field equations are linearized. At asymptotically large values, the threshold chemical potential for the appearance of excited condensate states are discrete, equal spacing, with the gap approaches zero logarithmically in the limit $T\rightarrow 0$. Remarkably, numerical results show that, this behavior applies even for states as low as for the first or the second excited state of the condensate. This is especially significant on the liquid side of the black hole van der Waals - like phase transition (small or zero topological charge) where there seems to be no gap between the ground state and the first excited state at zero temperature. We postulate that, at the exact limit $T = 0$ where the gap is zero, the spectrum of threshold chemical potentials becomes continuous, all excited states of the condensate are activated above a finite chemical potential, suggesting a new quantum phase transition as a function of the chemical potential. Previous studies have largely missed this continuous spectrum of excited states in the $T\rightarrow 0$ limit. This fact should be taken into account carefully in AdS/CFT duality studies.


title: The Replicator Dynamics of Zero-Sum Games Arise from a Novel Poisson Algebra

abstract: We show that the replicator dynamics for zero-sum games arises as a result of a non-canonical bracket that is a hybrid between a Poisson Bracket and a Nambu Bracket. The resulting non-canonical bracket is parameterized both the by the skew-symmetric payoff matrix and a mediating function. The mediating function is only sometimes a conserved quantity, but plays a critical role in the determination of the dynamics. As a by-product, we show that for the replicator dynamics this function arises in the definition of a natural metric on which phase flow-volume is preserved. Additionally, we show that the non-canonical bracket satisfies all the same identities as the Poisson bracket except for the Jacobi identity (JI), which is satisfied for special cases of the mediating function. In particular, the mediating function that gives rise to the replicator dynamics yields a bracket that satisfies JI. This neatly explains why the mediating function allows us to derive a metric on which phase flow is conserved and suggests a natural geometry for zero-sum games that extends the Symplectic geometry of the Poisson bracket and potentially an alternate approach to quantizing evolutionary games.


title: GOE fluctuations for the maximum of the top path in alternating sign matrices

abstract: The six-vertex model is an important toy-model in statistical mechanics for two-dimensional ice with a natural parameter $\Delta$. When $\Delta = 0$, the so-called free-fermion point, the model is in natural correspondence with domino tilings of the Aztec diamond. Although this model is integrable for all $\Delta$, there has been very little progress in understanding its statistics in the scaling limit for other values. In this work, we focus on the six-vertex model with domain wall boundary conditions at $\Delta = 1/2$, where it corresponds to alternating sign matrices (ASMs). We consider the level lines in a height function representation of ASMs. We show that the maximum of the topmost level line for a uniformly random ASMs has the GOE Tracy--Widom distribution after appropriate rescaling. A key ingredient in our proof is Zeilberger's proof of the ASM conjecture. As far as we know, this is the first edge fluctuation result away from the tangency points for the domain-wall six-vertex model when we are not in the free fermion case.


title: A common generalization of infinite sum, unordered sum and integral

abstract: We present a common ground for infinite sums, unordered sums, Riemann/Lebesgue integrals, arc length and some generalized means. It is based on extending functions on finite sets using Hausdorff metric in a natural way.


title: Building better spin models for merging binary black holes: Evidence for non-spinning and rapidly spinning nearly aligned sub-populations

abstract: Recent work paints a conflicting portrait of the distribution of black hole spins in merging binaries measured with gravitational waves. Some analyses find that a significant fraction of merging binaries contain at least one black hole with a spin tilt $>90^\circ$ with respect to the orbital angular momentum vector, which has been interpreted as a signature for dynamical assembly. Other analyses find the data are consistent with a bimodal population in which some binaries contain black holes with negligible spin while the rest contain black holes with spin vectors preferentially aligned with the orbital angular momentum vector. In this work, we scrutinize models for the distribution of black hole spins to pinpoint possible failure modes in which the model yields a faulty conclusion. We reanalyze data from the second LIGO--Virgo gravitational-wave transient catalog (GWTC-2) using a revised spin model, which allows for a sub-population of black holes with negligible spins. In agreement with recent results by Roulet et al., we show that the GWTC-2 detections are consistent with two distinct sub-populations. We estimate that $29-75\%$ (90\% credible interval) of merging binaries contain black holes with negligible spin $\chi \approx 0$. The remaining binaries are part of a second sub-population in which the spin vectors are preferentially (but not exactly) aligned to the orbital angular momentum. The black holes in this second sub-population are characterized by spins of $\chi\sim0.45$. We suggest that the inferred spin distribution is consistent with the hypothesis that all merging binaries form via the field formation scenario.


title: I-mode pedestal relaxation events in the Alcator C-Mod and ASDEX Upgrade tokamaks

abstract: In some conditions, I-mode plasmas can feature pedestal relaxation events (PREs) that transiently enhance the energy reaching the divertor target plates. To shed light into their appearance, characteristics and energy reaching the divertor targets, a comparative study between two tokamaks $-$ Alcator C-Mod and ASDEX Upgrade $-$ is carried out. It is found that PREs appear only in a subset of I-mode discharges, mainly when the plasma is close to the H-mode transition. Also, the nature of the triggering instability is discussed by comparing measurements close to the separatrix in both devices. The PRE relative energy loss from the confined region increases with decreasing pedestal top collisionality $\nu_{\mathrm{ped}}^*$. In addition, the relative electron temperature drop at the pedestal top, which is related to the conductive energy loss, rises with decreasing $\nu_{\mathrm{ped}}^*$. Finally, the peak parallel energy fluence due to the PRE measured on the divertor in both devices is compared to the model introduced in [1] for type-I ELMs. The model is shown to provide an upper boundary for PRE energy fluence data, while a lower boundary is found by dividing the model by three. These two boundaries are used to make projections to future devices such as DEMO and ARC.


title: Complementary Calibration: Boosting General Continual Learning with Collaborative Distillation and Self-Supervision

abstract: General Continual Learning (GCL) aims at learning from non independent and identically distributed stream data without catastrophic forgetting of the old tasks that don't rely on task boundaries during both training and testing stages. We reveal that the relation and feature deviations are crucial problems for catastrophic forgetting, in which relation deviation refers to the deficiency of the relationship among all classes in knowledge distillation, and feature deviation refers to indiscriminative feature representations. To this end, we propose a Complementary Calibration (CoCa) framework by mining the complementary model's outputs and features to alleviate the two deviations in the process of GCL. Specifically, we propose a new collaborative distillation approach for addressing the relation deviation. It distills model's outputs by utilizing ensemble dark knowledge of new model's outputs and reserved outputs, which maintains the performance of old tasks as well as balancing the relationship among all classes. Furthermore, we explore a collaborative self-supervision idea to leverage pretext tasks and supervised contrastive learning for addressing the feature deviation problem by learning complete and discriminative features for all classes. Extensive experiments on four popular datasets show that our CoCa framework achieves superior performance against state-of-the-art methods. Code is available at https://github.com/lijincm/CoCa.


title: A Markov chain approximation of switched Fokker-Planck equations for a model of on-off intermittency in the postural control during quiet standing

abstract: The intermittent on-off switching of feedback control is considered as a major mechanism of postural stabilization during human quiet standing, which can be modeled by switched-type hybrid stochastic delay differential equations with unstable subsystems. Dynamics of the model can also be described by the corresponding switched-type Fokker-Planck (FP) equations. Here, we develop a comprehensive numerical recipe to simulate switched-type FP equations in the case that the probability current is conserved at the switching boundary, as is the case for noise-free models exhibiting C^0-continuity for solutions at the boundary, but in a way extendable to cases with discontinuous jump. Specifically, the FP equations are approximated by a finite state Markov chain model using the finite element method. Then, dynamics of the Markov chain model, including time evolution of probability density function (PDF), stationary PDF, and power spectrum of postural sway are analyzed. We further investigate how the stationary PDF alters as values of important parameters of the model change. Dynamics of the Markov chain model are compared with Monte Carlo-based dynamics of the model, by which the developed numerical recipe is validated. The obtained Markov chain model forms a basis of our future investigations of the intermittent postural control as a Markov decision process.


title: Automated detection of COVID-19 cases from chest X-ray images using deep neural network and XGBoost

abstract: In late 2019 and after COVID-19 pandemic in the world, many researchers and scholars have tried to provide methods for detection of COVID-19 cases. Accordingly, this study focused on identifying COVID-19 cases from chest X-ray images. In this paper, a novel approach to diagnosing coronavirus disease from X-ray images was proposed. In the proposed method, DenseNet169 deep neural network was used to extract the features of X-ray images taken from the patients' chest and the extracted features were then given as input to the Extreme Gradient Boosting (XGBoost) algorithm so that it could perform the classification task. Evaluation of the proposed approach and its comparison with the methods presented in recent years revealed that the proposed method was more accurate and faster than the existing ones and had an acceptable performance in detection of COVID-19 cases from X-ray images.


title: Learning Neural Causal Models with Active Interventions

abstract: Discovering causal structures from data is a challenging inference problem of fundamental importance in all areas of science. The appealing properties of neural networks have recently led to a surge of interest in differentiable neural network-based methods for learning causal structures from data. So far, differentiable causal discovery has focused on static datasets of observational or fixed interventional origin. In this work, we introduce an active intervention targeting (AIT) method which enables a quick identification of the underlying causal structure of the data-generating process. Our method significantly reduces the required number of interactions compared with random intervention targeting and is applicable for both discrete and continuous optimization formulations of learning the underlying directed acyclic graph (DAG) from data. We examine the proposed method across multiple frameworks in a wide range of settings and demonstrate superior performance on multiple benchmarks from simulated to real-world data.


title: Hamiltonian Dynamics for the Kepler Problem in a Deformed Phase Space

abstract: This work addresses the Hamiltonian dynamics of the Kepler problem in a deformed phase space, by considering the equatorial orbit. The recursion operators are constructed and used to compute the integrals of motion. The same investigation is performed with the introduction of the Laplace-Runge-Lenz vector. The existence of quasi-bi-Hamiltonian structures is also elucidated. Related properties are studied.


title: On Length Divergence Bias in Textual Matching Models

abstract: Despite the remarkable success deep models have achieved in Textual Matching (TM) tasks, it still remains unclear whether they truly understand language or measure the semantic similarity of texts by exploiting statistical bias in datasets. In this work, we provide a new perspective to study this issue -- via the length divergence bias. We find the length divergence heuristic widely exists in prevalent TM datasets, providing direct cues for prediction. To determine whether TM models have adopted such heuristic, we introduce an adversarial evaluation scheme which invalidates the heuristic. In this adversarial setting, all TM models perform worse, indicating they have indeed adopted this heuristic. Through a well-designed probing experiment, we empirically validate that the bias of TM models can be attributed in part to extracting the text length information during training. To alleviate the length divergence bias, we propose an adversarial training method. The results demonstrate we successfully improve the robustness and generalization ability of models at the same time.


title: Using Proxies to Improve Forecast Evaluation

abstract: Comparative evaluation of forecasts of statistical functionals relies on comparing averaged losses of competing forecasts after the realization of the quantity $Y$, on which the functional is based, has been observed. Motivated by high-frequency finance, in this paper we investigate how proxies $\tilde Y$ for $Y$ - say volatility proxies - which are observed together with $Y$ can be utilized to improve forecast comparisons. We extend previous results on robustness of loss functions for the mean to general moments and ratios of moments, and show in terms of the variance of differences of losses that using proxies will increase the power in comparative forecast tests. These results apply both to testing conditional as well as unconditional dominance. Finally, we numerically illustrate the theoretical results, both for simulated high-frequency data as well as for high-frequency log returns of several cryptocurrencies.


title: Average Trapping time on the 3-dimensional 3-level Sierpinski gasket network with a set of trap nodes

abstract: As a basic dynamic feature on complex networks, the property of random walk has received a lot of attention in recent years. In this paper, we first studied the analytical expression of the mean global first passage time (MGFPT) on the 3-dimensional 3-level Sierpinski gasket network. Based on the self-similar structure of the network, the correlation between the MGFPT and the average trapping time (ATT) is found, and then the analytical expression of the ATT is obtained. Finally, by establishing a joint network model, we further give the standard process of solving the analytical expression of the ATT when there is a set of trap nodes in the network. By illustrating examples and numerical simulations, it can be proved that when the trap node sets are different, the ATT will be quite different, but the the super-linear relationship with the number of iterations will not be changed.


title: Average trapping time on a type of horizontally segmented 3 dimensional Sierpinski gasket network with two types of locally self-similar structures

abstract: As a classic self-similar network model, Sierpinski gasket network has been used many times to study the characteristics of self-similar structure and its influence on the dynamic properties of the network. However, the network models studied in these problems only contain a single self-similar structure, which is inconsistent with the structural characteristics of the actual network models. In this paper, a type of horizontally segmented 3 dimensional Sierpinski gasket network is constructed, whose main feature is that it contains the locally self-similar structures of the 2 dimensional Sierpinski gasket network and the 3 dimensional Sierpinski gasket network at the same time, and the scale transformation between the two kinds of self-similar structures can be controlled by adjusting the crosscutting coefficient. The analytical expression of the average trapping time on the network model is solved, which used to analyze the effect of two types of self-similar structures on the properties of random walks. Finally, we conclude that the dominant self-similar structure will exert a greater influence on the random walk process on the network.


title: Machine Learning Application for $\mathbf{\Lambda}$ Hyperon Reconstruction in CBM at FAIR

abstract: The Compressed Baryonic Matter experiment at FAIR will investigate the QCD phase diagram in the region of high net-baryon densities. Enhanced production of strange baryons, such as the most abundantly produced $\Lambda$ hyperons, can signal transition to a new phase of the QCD matter. In this work, the CBM performance for reconstruction of the $\Lambda$ hyperon via its decay to proton and $\pi^{-}$ is presented. Decay topology reconstruction is implemented in the Particle-Finder Simple (PFSimple) package with Machine Learning algorithms providing efficient selection of the decays and high signal to background ratio.


title: ReLaX: Retinal Layer Attribution for Guided Explanations of Automated Optical Coherence Tomography Classification

abstract: 30 million Optical Coherence Tomography (OCT) imaging tests are issued annually to diagnose various retinal diseases, but accurate diagnosis of OCT scans requires trained eye care professionals who are still prone to making errors. With better systems for diagnosis, many cases of vision loss caused by retinal disease could be entirely avoided. In this work, we present ReLaX, a novel deep learning framework for explainable, accurate classification of retinal pathologies which achieves state-of-the-art accuracy. Furthermore, we emphasize producing both qualitative and quantitative explanations of the model's decisions. While previous works use pixel-level attribution methods for generating model explanations, our work uses a novel retinal layer attribution method for producing rich qualitative and quantitative model explanations. ReLaX determines the importance of each retinal layer by combining heatmaps with an OCT segmentation model. Our work is the first to produce detailed quantitative explanations of a model's predictions in this way. The combination of accuracy and interpretability can be clinically applied for accessible, high-quality patient care.


title: Force Detection Sensitivity Spectrum Calibration of Levitated Nanomechanical Sensor Using Harmonic Coulomb Force

abstract: Oscillators based on levitated particles are promising for the development of ultrasensitive force detectors. The theoretical performance of levitated nanomechanical sensors is usually characterized by the so-called thermal noise limit force detection sensitivity, which does not exhibit spectral specificity in practical measurements. To characterize the actual detection performance, we propose a method for the force detection sensitivity calibration of a levitated nanomechanical sensor based on the harmonic Coulomb force. Utilizing the measured transfer function, we obtained the force detection sensitivity spectrum from the position spectrum. Although the thermal noise limit force detection sensitivity of the system reached $\rm\left( {4.39 \pm 0.62} \right) \times {10^{ - 20}} N/H{z^{1/2}}$ at $\rm{2.4\times10^{-6} mbar}$ with feedback cooling, the measured sensitivity away from the resonance was of the order of $\rm10^{-17} N/Hz^{1/2}$ based on the existing detection noise level. The calibration method established in our study is applicable to the performance evaluation of any optical levitation system for high-sensitivity force measurements.


title: A short note on basic of information geometry from thermodynamics and thermostatistics

abstract: This is a short note for some basics of information geometry from thermodynamics and Callen's themostatistics.


title: Developing and validating multi-modal models for mortality prediction in COVID-19 patients: a multi-center retrospective study

abstract: The unprecedented global crisis brought about by the COVID-19 pandemic has sparked numerous efforts to create predictive models for the detection and prognostication of SARS-CoV-2 infections with the goal of helping health systems allocate resources. Machine learning models, in particular, hold promise for their ability to leverage patient clinical information and medical images for prediction. However, most of the published COVID-19 prediction models thus far have little clinical utility due to methodological flaws and lack of appropriate validation. In this paper, we describe our methodology to develop and validate multi-modal models for COVID-19 mortality prediction using multi-center patient data. The models for COVID-19 mortality prediction were developed using retrospective data from Madrid, Spain (N=2547) and were externally validated in patient cohorts from a community hospital in New Jersey, USA (N=242) and an academic center in Seoul, Republic of Korea (N=336). The models we developed performed differently across various clinical settings, underscoring the need for a guided strategy when employing machine learning for clinical decision-making. We demonstrated that using features from both the structured electronic health records and chest X-ray imaging data resulted in better 30-day-mortality prediction performance across all three datasets (areas under the receiver operating characteristic curves: 0.85 (95% confidence interval: 0.83-0.87), 0.76 (0.70-0.82), and 0.95 (0.92-0.98)). We discuss the rationale for the decisions made at every step in developing the models and have made our code available to the research community. We employed the best machine learning practices for clinical model development. Our goal is to create a toolkit that would assist investigators and organizations in building multi-modal models for prediction, classification and/or optimization.


title: Renormalization of Electromagnetic Quantities in Small Josephson Junctions

abstract: This doctorate thesis focuses on the effects of the electromagnetic environment on applied electromagnetic fields in single small junctions as well as arrays. We apply radio-frequency (RF) microwaves in the sub-gigahertz frequency range on a one-dimensional array of small Josephson junctions exhibiting distinct Coulomb blockade characteristics. We observed a gradual lifting of Coulomb blockade with increase in the microwave power which we interpret is due to photon-assisted tunneling of Cooper pairs in the classical (multi-photon absorption) regime. We observe that, due to its high sensitivity to microwave power, the array is well-suited for in situ microwave detection applications in low temperature environments. A detailed analysis of the characteristics in the classical (multi-photon absorption) limit reveals that the microwave amplitude is rescaled (renormalized), which we attribute to the difference in dc and ac voltage response of the array. We proceed to rigorously consider the origin of the aforementioned renormalization effect by considering the effect of the electromagnetic environment of the Josephson junction on applied oscillating voltages. We theoretically demonstrate that its effect is simply to renormalize the amplitude of oscillation in a predictable manner traced to the physics of wave function renormalization (Lehmann weights) consistent with circuit-QED. We also introduce Einstein's A and B coefficients for small Josephson junctions, in a bid to relate the renormalization effect to the modification of photon absorption and emission amplitudes. Such renormalization implies that the sensitivity of the single junction and the array to oscillating electromagnetic fields (e.g. microwaves) is modulated and depends on the environmental impedance. The renormalization effect can be exploited to configure `opaque', `translucent' or `transparent' quantum circuits to microwaves.


title: Application of Monte Carlo Stochastic Optimization (MOST) to Deep Learning

abstract: In this paper, we apply the Monte Carlo stochastic optimization (MOST) proposed by the authors to a deep learning of XOR gate and verify its effectiveness. Deep machine learning based on neural networks is one of the most important keywords driving innovation in today's highly advanced information society. Therefore, there has been active research on large-scale, high-speed, and high-precision systems. For the purpose of efficiently searching the optimum value of the objective function, the author divides the search region of a multivariable parameter constituting the objective function into two by each parameter, numerically finds the integration of the two regions by the Monte Carlo method, compares the magnitude of the integration value, and judges that there is an optimum point in a small region. In the previous paper, we examined the problem of the benchmark in the optimization method. This method is applied to neural networks of XOR gate, and compared with the results of weight factor optimization by Adam and genetic algorithm. As a result, it was confirmed that it converged faster than the existing method.


title: Parkinson's Disease Diagnosis based on Gait Cycle Analysis Through an Interpretable Interval Type-2 Neuro-Fuzzy System

abstract: In this paper, an interpretable classifier using an interval type-2 fuzzy neural network for detecting patients suffering from Parkinson's Disease (PD) based on analyzing the gait cycle is presented. The proposed method utilizes clinical features extracted from the vertical Ground Reaction Force (vGRF), measured by 16 wearable sensors placed in the soles of subjects' shoes and learns interpretable fuzzy rules. Therefore, experts can verify the decision made by the proposed method based on investigating the firing strength of interpretable fuzzy rules. Moreover, experts can utilize the extracted fuzzy rules for patient diagnosing or adjust them based on their knowledge. To improve the robustness of the proposed method against uncertainty and noisy sensor measurements, Interval Type-2 Fuzzy Logic is applied. To learn fuzzy rules, two paradigms are proposed: 1- A batch learning approach based on clustering available samples is applied to extract initial fuzzy rules, 2- A complementary online learning is proposed to improve the rule base encountering new labeled samples. The performance of the method is evaluated for classifying patients and healthy subjects in different conditions including the presence of noise or observing new instances. Moreover, the performance of the model is compared to some previous supervised and unsupervised machine learning approaches. The final Accuracy, Precision, Recall, and F1 Score of the proposed method are 88.74%, 89.41%, 95.10%, and 92.16%. Finally, the extracted fuzzy sets for each feature are reported.


title: Transfer function asymmetry in Fabry-P\'erot based optical pressure sensors

abstract: Optical resonators are one of the most promising optical devices for manufacturing high-performance pressure sensors for photoacoustic imaging. Among these, Fabry-P\'erot (FP) based pressure sensors have been successfully used for a multitude of applications. However, critical performance aspects of FP based pressure sensors have not been extensively studied, including the effects system parameters such as beam diameter and cavity misalignment have on transfer function shape. Here, we discuss the possible origins of the transfer function asymmetry, the impact it has on measurement sensitivity as well as ways to correctly estimate the FP pressure sensitivity under practical experimental conditions.


title: Top-N Recommendation with Counterfactual User Preference Simulation

abstract: Top-N recommendation, which aims to learn user ranking-based preference, has long been a fundamental problem in a wide range of applications. Traditional models usually motivate themselves by designing complex or tailored architectures based on different assumptions. However, the training data of recommender system can be extremely sparse and imbalanced, which poses great challenges for boosting the recommendation performance. To alleviate this problem, in this paper, we propose to reformulate the recommendation task within the causal inference framework, which enables us to counterfactually simulate user ranking-based preferences to handle the data scarce problem. The core of our model lies in the counterfactual question: "what would be the user's decision if the recommended items had been different?". To answer this question, we firstly formulate the recommendation process with a series of structural equation models (SEMs), whose parameters are optimized based on the observed data. Then, we actively indicate many recommendation lists (called intervention in the causal inference terminology) which are not recorded in the dataset, and simulate user feedback according to the learned SEMs for generating new training samples. Instead of randomly intervening on the recommendation list, we design a learning-based method to discover more informative training samples. Considering that the learned SEMs can be not perfect, we, at last, theoretically analyze the relation between the number of generated samples and the model prediction error, based on which a heuristic method is designed to control the negative effect brought by the prediction error. Extensive experiments are conducted based on both synthetic and real-world datasets to demonstrate the effectiveness of our framework.


title: Multi-modal Program Inference: a Marriage of Pre-trainedLanguage Models and Component-based Synthesis

abstract: Multi-modal program synthesis refers to the task of synthesizing programs (code) from their specification given in different forms, such as a combination of natural language and examples. Examples provide a precise but incomplete specification, and natural language provides an ambiguous but more "complete" task description. Machine-learned pre-trained models (PTMs) are adept at handling ambiguous natural language, but struggle with generating syntactically and semantically precise code. Program synthesis techniques can generate correct code, often even from incomplete but precise specifications, such as examples, but they are unable to work with the ambiguity of natural languages. We present an approach that combines PTMs with component-based synthesis (CBS): PTMs are used to generate candidates programs from the natural language description of the task, which are then used to guide the CBS procedure to find the program that matches the precise examples-based specification. We use our combination approach to instantiate multi-modal synthesis systems for two programming domains: the domain of regular expressions and the domain of CSS selectors. Our evaluation demonstrates the effectiveness of our domain-agnostic approach in comparison to a state-of-the-art specialized system, and the generality of our approach in providing multi-modal program synthesis from natural language and examples in different programming domains.


title: On mass spectra of primordial black holes

abstract: Evidences for the primordial black holes (PBH) presence in the early Universe renew permanently. New limits on their mass spectrum challenge existing models of PBH formation. One of the known model is based on the closed walls collapse after the inflationary epoch. Its intrinsic feature is multiple production of small mass PBH which might contradict observations in the nearest future. We show that the mechanism of walls collapse can be applied to produce substantially different PBH mass spectra if one takes into account the classical motion of scalar fields together with their quantum fluctuations at the inflationary stage.


title: Search for exotic decays of the Higgs boson into $b\bar{b}$ and missing transverse momentum in $pp$ collisions at $\sqrt{s} = 13$ TeV with the ATLAS detector

abstract: A search for the exotic decay of the Higgs boson ($H$) into a $b\bar{b}$ resonance plus missing transverse momentum is described. The search is performed with the ATLAS detector at the Large Hadron Collider using 139 $\mathrm{fb}^{-1}$ of $pp$ collisions at $\sqrt{s} = 13$ TeV. The search targets events from $ZH$ production in an NMSSM scenario where $H \rightarrow \tilde{\chi}^{0}_{2}\tilde{\chi}^{0}_{1}$, with $\tilde{\chi}^{0}_{2} \rightarrow {a} \tilde{\chi}^{0}_{1}$, where $a$ is a light pseudoscalar Higgs boson and $\tilde{\chi}^{0}_{1,2}$ are the two lightest neutralinos. The decay of the $a$ boson into a pair of $b$-quarks results in a peak in the dijet invariant mass distribution. The final-state signature consists of two leptons, two or more jets, at least one of which is identified as originating from a $b$-quark, and missing transverse momentum. Observations are consistent with Standard Model expectations and upper limits are set on the product of cross section times branching ratio for a three-dimensional scan of the masses of the $\tilde{\chi}^{0}_{2}$, $\tilde{\chi}^{0}_{1}$ and $a$ boson.


title: Measurement of Excess Noise in Thin Film and Metal Foil Resistor Networks

abstract: Low-frequency resistance fluctuations cause excess noise in biased resistors. The magnitude of these fluctuations varies significantly between different resistor types. In this work measurements of excess noise in precision thin film and metal foil resistor networks are presented. The lowest levels were found in metal foil devices, followed by thin film NiCr networks deposited on silicon substrates. Higher excess noise with a significant spread between different types was seen in thin film devices deposited on ceramic substrates.


title: Ricci curvature integrals, local functionals, and the Ricci flow

abstract: Consider a Riemannian manifold $(M^{m}, g)$ whose volume is the same as the standard sphere $(S^{m}, g_{round})$. If $p>\frac{m}{2}$ and $\int_{M} \left\{ Rc-(m-1)g\right\}_{-}^{p} dv$ is sufficiently small, we show that the normalized Ricci flow initiated from $(M^{m}, g)$ will exist immortally and converge to the standard sphere. The choice of $p$ is optimal.


title: High-Intensity and Uniform Red-Green-Blue Triple Reflective Bands Achieved by Rationally-Designed Ultrathin Heterostructure Photonic Crystals

abstract: The relationships between material constructions and reflective spectrum patterns are important properties of photonic crystals. One particular interesting reflectance profile is a high-intensity and uniform three-peak pattern with peak positions right located at the red, green, and blue (RGB, three original colors) region. For ease of construction, a seek for using one-dimensional photonic crystals to achieve RGB triple reflective bands is a meaningful endeavor. Only very limited previous studies exist, all relying on traditional periodic photonic crystals (PPCs) and of large thickness. The underlying physical principles remain elusive, leaving the question of thickness limit to achieve RGB bands unaddressed. Here, we present the first detailed work to explore the thickness limit issue based on both theoretical and experimental investigation. A set of heuristically derived design principles are used to uncover that the break of translational symmetry, thus introducing heterostructure photonic crystals (HPCs), is essential to reduce the total optical path difference (OPD) to ~ 3200nm (the theoretical limit) while still exhibiting high-quality RGB bands. A systematic experiment based on a 12-layer heterostructure construction was performed and well confirmed the theoretical predictions. The associated three-peak properties are successfully used to realize quantum dot fluorescent enhancement phenomena. Furthermore, the HPC exhibits unusually stability against solvent stimulus, in strong contrast to typical behaviors reported in PPCs. Our work for the first time proposes and verifies important rational rules for designing ultrathin HPCs toward RGB reflective bands, and provides insights for a wider range of explorations of light manipulation in photonic crystals.


title: On viscosity solutions of path-dependent Hamilton--Jacobi--Bellman--Isaacs equations for fractional-order systems

abstract: This paper deals with a two-person zero-sum differential game for a dynamical system described by a Caputo fractional differential equation of order $\alpha \in (0, 1)$ and a Bolza cost functional. The differential game is associated to the Cauchy problem for the path-dependent Hamilton--Jacobi--Bellman--Isaacs equation with so-called fractional coinvariant derivatives of the order $\alpha$ and the corresponding right-end boundary condition. A notion of a viscosity solution of the Cauchy problem is introduced, and the value functional of the differential game is characterized as a unique viscosity solution of this problem.


title: Keep it green, simple and socially fair: a choice experiment on prosumers' preferences for peer to peer electricity trading in the Netherlands

abstract: While the potential for peer-to-peer electricity trading, where households trade surplus electricity with peers in a local energy market, is rapidly growing, the drivers of participation in this trading scheme have been understudied so far. In particular, there is a dearth of research on the role of non-monetary incentives for trading surplus electricity, despite their potentially important role. This paper presents the first discrete choice experiment conducted with prosumers (i.e. proactive households actively managing their electricity production and consumption) in the Netherlands. Electricity trading preferences are analyzed regarding economic, environmental, social and technological parameters, based on survey data (N = 74). The dimensions most valued by prosumers are the environmental and, to a lesser extent, economic dimensions, highlighting the key motivating roles of environmental factors. Furthermore, a majority of prosumers stated they would provide surplus electricity for free or for non-monetary compensations, especially to energy-poor households. These observed trends were more pronounced among members of energy cooperatives. This suggests that peer-to-peer energy trading can advance a socially just energy transition. Regarding policy recommendations, these findings point to the need for communicating environmental and economic benefits when marketing P2P electricity trading platforms and for technical designs enabling effortless and customizable transactions


title: Comparing the scalar-field dark energy models with recent observations

abstract: We investigate the general properties of a class of scalar-field dark energy models (i.e., $\phi$CDM models) which behave like cosmological trackers at early times. Particularly, we choose three $\phi$CDM models with typical potentials, i.e., $V(\phi)\propto \phi^{-\alpha}$ (inverse power-law (IPL) model), $V(\phi)\propto \coth^{\alpha}{\phi}$ (L-model) and $V(\phi)\propto \cosh(\alpha\phi)$ (Oscillatory tracker model), where the latter two models are based on the $\alpha$-attractors originated from the study of inflation. These models, which reduce to the $\Lambda$CDM model with $\alpha \to 0$, are studied and compared with the recent observations, including the Pantheon sample of type Ia supernovae (SNe Ia), baryon acoustic oscillations (BAO) measurements extracted from 6dFGS, BOSS and eBOSS, as well as the temperature and polarization anisotropy power spectra data of cosmic microwave background radiation (CMB) from Planck 2018 results. The observational constraints from the combining sample (SNe Ia + BAO + CMB) indicate that none of the three $\phi$CDM models exclude the $\Lambda$CDM model at $68.3\%$ confidence level. We find that the CMB anisotropy data have obvious advantages in constraining the dark energy models compared with other cosmological probes, which is particularly evident in the L-model. Furthermore, we apply the Bayesian evidence to compare the $\phi$CDM models and the $\Lambda$CDM model with the analysis of the combining sample. The concordance $\Lambda$CDM model is still the most supported one. In addition, among the three $\phi$CDM models, the IPL model is the most competitive one, while the L-model/Oscillatory tacker model is moderately/strongly disfavored.


title: On the generation of Metric TSP instances with a large integrality gap by branch-and-cut

abstract: This paper introduces a computational method for generating metric Travelling Salesman Problem (TSP) instances having a large integrality gap. The method is based on the solution of an integer programming problem, called IH-OPT, that takes as input a fractional solution of the Subtour Elimination Problem (SEP) on a TSP instance and computes a TSP instance having an integrality gap larger than or equal to the integrality gap of the first instance. The decision variables of IH-OPT are the entries of the TSP cost matrix, and the constraints are defined by the intersection of the metric cone with an exponential number of inequalities, one for each possible TSP tour. Given the very large number of constraints, we have implemented a branch-and-cut algorithm for solving IH-OPT. Then, by sampling cost vectors over the metric polytope and by solving the corresponding SEP, we can generate random fractional vertices of the SEP polytope. If we solve the IH-OPT problem for every sampled vertex using our branch-and-cut algorithm, we can select the generated TSP instance (i.e., cost vector), yielding the longest runtime for Concorde, the state-of-the-art TSP solver. Our computational results show that our method is very effective in producing challenging instances. As a by-product, we release the Hard-TSPLIB, a library of 41 small metric TSP instances which have a large integrality gap and are challenging in terms of runtime for Concorde.


title: Stochastic Subgradient Descent on a Generic Definable Function Converges to a Minimizer

abstract: It was previously shown by Davis and Drusvyatskiy that every Clarke critical point of a generic, semialgebraic (and more generally definable in an o-minimal structure), weakly convex function is lying on an active manifold and is either a local minimum or an active strict saddle. In the first part of this work, we show that when the weak convexity assumption fails a third type of point appears: a sharply repulsive critical point. Moreover, we show that the corresponding active manifolds satisfy the Verdier and the angle conditions which were introduced by us in our previous work. In the second part of this work, we show that, under a density-like assumption on the perturbation sequence, the stochastic subgradient descent (SGD) avoids sharply repulsive critical points with probability one. We show that such a density-like assumption could be obtained upon adding a small random perturbation (e.g. a nondegenerate Gaussian) at each iteration of the algorithm. These results, combined with our previous work on the avoidance of active strict saddles, show that the SGD on a generic definable (e.g. semialgebraic) function converges to a local minimum.


title: Accuracy of environmental tracers and consequence for determining the Type Ia Supernovae magnitude step

abstract: Type Ia Supernovae (SNe Ia) are standardizable candles that allow us to measure the recent expansion rate of the Universe. Due to uncertainties in progenitor physics, potential astrophysical dependencies may bias cosmological measurements if not properly accounted for. The dependency of the intrinsic luminosity of SNe Ia with their host-galaxy environment is often used to standardize SNe Ia luminosity and is commonly parameterized as a step function. This functional form implicitly assumes two-populations of SNe Ia. In the literature, multiple environmental indicators have been considered, finding different, sometimes incompatible, step function amplitudes. We compare these indicators in the context of a two-populations model, based on their ability to distinguish the two populations. We show that local H$\alpha$-based specific star formation rate (lsSFR) and global stellar mass are better tracers than, for instance, host galaxy morphology. We show that tracer accuracy can explain the discrepancy between the observed SNe Ia step amplitudes found in the literature. Using lsSFR or global mass to distinguish the two populations can explain all other observations, though lsSFR is favoured. As lsSFR is strongly connected to age, our results favour a prompt and delayed population model. In any case, there exists two populations that differ in standardized magnitude by at least $0.121\pm0.010\,\mathrm{mag}$.


title: Efficient Mind-Map Generation via Sequence-to-Graph and Reinforced Graph Refinement

abstract: A mind-map is a diagram that represents the central concept and key ideas in a hierarchical way. Converting plain text into a mind-map will reveal its key semantic structure and be easier to understand. Given a document, the existing automatic mind-map generation method extracts the relationships of every sentence pair to generate the directed semantic graph for this document. The computation complexity increases exponentially with the length of the document. Moreover, it is difficult to capture the overall semantics. To deal with the above challenges, we propose an efficient mind-map generation network that converts a document into a graph via sequence-to-graph. To guarantee a meaningful mind-map, we design a graph refinement module to adjust the relation graph in a reinforcement learning manner. Extensive experimental results demonstrate that the proposed approach is more effective and efficient than the existing methods. The inference time is reduced by thousands of times compared with the existing methods. The case studies verify that the generated mind-maps better reveal the underlying semantic structures of the document.


title: On non-structural subtype entailment

abstract: We prove that the non-structural subtype entailment problem for finite and regular type expressions is in PSPACE. In this way we close a decidability and complexity gap pending since 1996.


title: Determining optical properties of skin ex-vivo: An inverse solution

abstract: A rapid and accurate numerical solution to the transport equation (i.e., inverse adding doubling) of diffuse reflectance has been utilized here for the calculation of optical properties of the Yucatan miniature pigskin as human surrogate skin. This method is valid for a wide range of optical properties and can be adapted to a variety of probe geometries, provided calibration measurements are made. Inverse adding doubling (IAD), based on the forward solution to the transport equation is a numerical solution in which optical properties can be used as a prior for computing other properties for turbid media. In this work, integrating spheres with fitted laser diodes and a monochromator was used experimentally as the irradiation source. A cryo-microtome was used to precisely slice tissue samples. Confocal and atomic force microscopy optical methods were used to visualize tissue post-irradiation. The results from this work offer an additional method to determine the optical properties of biological tissues.


title: Calorimetric classification of track-like signatures in liquid argon TPCs using MicroBooNE data

abstract: The MicroBooNE liquid argon time projection chamber located at Fermilab is a neutrino experiment dedicated to the study of short-baseline oscillations, the measurements of neutrino cross sections in liquid argon, and to the research and development of this novel detector technology. Accurate and precise measurements of calorimetry are essential to the event reconstruction and are achieved by leveraging the TPC to measure deposited energy per unit length along the particle trajectory, with mm resolution. We describe the non-uniform calorimetric reconstruction performance in the detector, showing dependence on the angle of the particle trajectory. Such non-uniform reconstruction directly affects the performance of the particle identification algorithms which infer particle type from calorimetric measurements. This work presents a new particle identification method which accounts for and effectively addresses such non-uniformity. The newly developed method shows improved performance compared to previous algorithms, illustrated by a 94% proton selection efficiency and a 10% muon mis-identification rate, with a fairly loose selection of tracks performed on beam data. The performance is further demonstrated by identifying exclusive final states in $\nu_{\mu} CC$ interactions. While developed using MicroBooNE data and simulation, this method is easily applicable to future LArTPC experiments, such as SBND, ICARUS, and DUNE.


title: Supercoherent states of the open NS world sheet superstring

abstract: The supercoherent states of the RNS string are constructed using the covariant quantization and analogously the light cone quantization formalisms. Keeping intact the original definition of coherent states of harmonic oscillators, we extend the bosonic annihalation operator into the superspace by inclusion of fermionic contribution to oscillator modes thus construct the supercoherent states with supersymetric harmonic oscillator. We analyse the statistics of these states by explicitly calculating the Mandel parameter and obtained interesting results about the nature of distribution of the states


title: A Dynamic Topic Identification and Labeling Approach of COVID-19 Tweets

abstract: This paper formulates the problem of dynamically identifying key topics with proper labels from COVID-19 Tweets to provide an overview of wider public opinion. Nowadays, social media is one of the best ways to connect people through Internet technology, which is also considered an essential part of our daily lives. In late December 2019, an outbreak of the novel coronavirus, COVID-19 was reported, and the World Health Organization declared an emergency due to its rapid spread all over the world. The COVID-19 epidemic has affected the use of social media by many people across the globe. Twitter is one of the most influential social media services, which has seen a dramatic increase in its use from the epidemic. Thus dynamic extraction of specific topics with labels from tweets of COVID-19 is a challenging issue for highlighting conversation instead of manual topic labeling approach. In this paper, we propose a framework that automatically identifies the key topics with labels from the tweets using the top Unigram feature of aspect terms cluster from Latent Dirichlet Allocation (LDA) generated topics. Our experiment result shows that this dynamic topic identification and labeling approach is effective having the accuracy of 85.48\% with respect to the manual static approach.


title: Learning to Perform Downlink Channel Estimation in Massive MIMO Systems

abstract: We study downlink (DL) channel estimation in a multi-cell Massive multiple-input multiple-output (MIMO) system operating in a time-division duplex. The users must know their effective channel gains to decode their received DL data signals. A common approach is to use the mean value as the estimate, motivated by channel hardening, but this is associated with a substantial performance loss in non-isotropic scattering environments. We propose two novel estimation methods. The first method is model-aided and utilizes asymptotic arguments to identify a connection between the effective channel gain and the average received power during a coherence block. The second one is a deep-learning-based approach that uses a neural network to identify a mapping between the available information and the effective channel gain. We compare the proposed methods against other benchmarks in terms of normalized mean-squared error and spectral efficiency (SE). The proposed methods provide substantial improvements, with the learning-based solution being the best of the considered estimators.


title: Practical and Secure Federated Recommendation with Personalized Masks

abstract: Federated recommendation addresses the data silo and privacy problems altogether for recommender systems. Current federated recommender systems mainly utilize cryptographic or obfuscation methods to protect the original ratings from leakage. However, the former comes with extra communication and computation costs, and the latter damages model accuracy. Neither of them could simultaneously satisfy the real-time feedback and accurate personalization requirements of recommender systems. In this paper, we proposed federated masked matrix factorization (FedMMF) to protect the data privacy in federated recommender systems without sacrificing efficiency and effectiveness. In more details, we introduce the new idea of personalized mask generated only from local data and apply it in FedMMF. On the one hand, personalized mask offers protection for participants' private data without effectiveness loss. On the other hand, combined with the adaptive secure aggregation protocol, personalized mask could further improve efficiency. Theoretically, we provide security analysis for personalized mask. Empirically, we also show the superiority of the designed model on different real-world data sets.


title: POD-based study of turbulent plane Poiseuille flow: comparing structure and dynamics between quasi-linear simulations and DNS

abstract: Turbulence in the restricted nonlinear (RNL) dynamics is analyzed and compared with DNS of Poiseuille turbulence at $R=1650$. The structures are obtained by POD analysis of the two components of the flow partition used in RNL dynamics: the streamwise-mean flow and fluctuations. POD analysis of the streamwise-mean flow indicates that the dominant POD modes, in both DNS and RNL, are roll-streaks harmonic in the spanwise. However, we conclude that these POD modes do not occur in isolation but rather are Fourier components of a coherent roll-streak structure. POD analysis of the fluctuations in DNS and RNL reveals similar complex structures consisting in part of oblique waves collocated with the streak. The origin of these structures is identified by their correspondence to POD modes predicted using a stochastic turbulence model (STM). These predicted POD modes are dominated by the optimally growing structures on the streak, which the STM predicts correctly to be of sinuous oblique wave structure. This close correspondence between the roll-streak structure and the associated fluctuations in DNS, RNL and the STM implies that the self-sustaining mechanism operating in DNS is essentially the same as that in RNL, which has been previously associated with optimal perturbation growth on the streak.


title: Non-sensitive axis feedback control of test mass in full-maglev vertical superconducting gravity instruments

abstract: Non-sensitive axis feedback control is crucial for cross-coupling noise suppression in the application of full-maglev vertical superconducting gravity instruments. This paper introduces the non-sensitive axis feedback control of the test mass in a home-made full-maglev vertical superconducting accelerometer. In the feedback system, special superconducting circuits are designed to decouple and detect the multi-degrees-of-freedom motions of the test mass. Then the decoupled motion signals are dealt with by the PID controller and fed back to the side-wall coils to control the test mass. In our test, the test mass is controlled successfully and the displacement is reduced by about one order of magnitude in the laboratory. Accordingly, the noise level of the vertical superconducting accelerometer in the sensitive axis is also reduced.


title: Frequency-Phase-Locking Mechanism inside DC SQUIDs and The Analytical Expression of Current-Voltage Characteristics

abstract: Direct-current superconducting quantum interference devices (dc SQUIDs) are ultra-sensitive flux-to-voltage convertors widely applied for biomagnetism and geophysics; they are working as the magnetic-field-effect transistors (MFETs) for their flux-modulated current-voltage characteristics. However, unlike semiconductor FETs, dc SQUIDs lack general analytical models and expressions to interpret the inner dynamics and outside current-voltage characteristics. This work presents a frequency-phase-locking (FPL) model and the analytical expression to reveal the how the current-voltage characteristics are formed inside dc SQUIDs, and how the characteristics are quantitively decided by the circuit parameters. The application of the analytical expression for the calculations of current-voltage characteristics is demonstrated; the results are compared with the numerical simulations. It is shown that a dc-SQUID is an FPL system inside and a current-modified nonlinear resistor outside; its current-voltage characteristics formed by FPL mechanism are the projections of three network impedances driven by Josephson currents. Based on the FPL model and the analytical expression, dc SQUIDs can be simply treated as nonlinear resistors in practical applications; their performance can be directly predicted and evaluated according to three network impedances.


title: Secondary frequency control stabilizing voltage dynamics

abstract: The ongoing energy transition challenges the stability of the electrical power system. Stable operation of the electrical power grid requires both the voltage (amplitude) and the frequency to stay within operational bounds. While much research has focused on frequency dynamics and stability, the voltage dynamics has been neglected. Here, we study frequency and voltage stability in the case of simple networks via linear stability and bulk analysis. In particular, our linear stability analysis of the network shows that the frequency secondary control guarantees the stability of a particular electric network. Even more interesting, while we only consider secondary frequency control, we observe a stabilizing effect on the voltage dynamics, especially in our numerical bulk analysis.


title: Active Learning for Automated Visual Inspection of Manufactured Products

abstract: Quality control is a key activity performed by manufacturing enterprises to ensure products meet quality standards and avoid potential damage to the brand's reputation. The decreased cost of sensors and connectivity enabled an increasing digitalization of manufacturing. In addition, artificial intelligence enables higher degrees of automation, reducing overall costs and time required for defect inspection. In this research, we compare three active learning approaches and five machine learning algorithms applied to visual defect inspection with real-world data provided by Philips Consumer Lifestyle BV. Our results show that active learning reduces the data labeling effort without detriment to the models' performance.


title: The Effect of Cosmic Ray Muon Momentum Measurement for Monitoring Shielded Special Nuclear Materials

abstract: Recently, cosmic ray muons have been considered as a potential high energy radiation probe for monitoring and interrogation of dense, well-shielded special nuclear materials (SNM). Due to their high-penetrative nature, cosmic ray muons can easily penetrate shielded nuclear materials with minimal absorption and with leaving the target objects intact. However, despite the potential benefits from using cosmic ray muons for SNM monitoring, their widespread application has been limited for various reasons, including relatively low cosmic ray muon flux at sea level and the difficulty of measuring muon momentum in the field which can increase resolution and reduce measurement time. In this work, we explore in detail the effect of cosmic ray muon momentum measurement, focusing specifically on SNM monitoring applications. Three different types of SNMs (HEU, LEU, and Pu) surrounded by lead shielding with five different thicknesses (0, 5, 10, 20, and 30 cm), are analyzed using Monte Carlo simulation for three momentum measurement resolution levels (perfect, limited, and absent). 1000 muons were generated in the simulation which translates to 4 minutes of measurement time for a standard cargo container. We found that it is possible to identify and separate HEU, LEU, and Pu with high accuracy (> 3 s.d.) when using muon momentum measurement (perfect and limited) even when 30 cm-thick lead shielding was used. Currently, it is not possible to identify or separate the SNMs with 30 cm thick lead shielding without muon momentum knowledge. Our results show that the effect of measuring muon momentum can be significant and can result in reduced measurement times by a factor of 3 to 4 and/or improved monitoring and imaging resolution.


title: Binary Code based Hash Embedding for Web-scale Applications

abstract: Nowadays, deep learning models are widely adopted in web-scale applications such as recommender systems, and online advertising. In these applications, embedding learning of categorical features is crucial to the success of deep learning models. In these models, a standard method is that each categorical feature value is assigned a unique embedding vector which can be learned and optimized. Although this method can well capture the characteristics of the categorical features and promise good performance, it can incur a huge memory cost to store the embedding table, especially for those web-scale applications. Such a huge memory cost significantly holds back the effectiveness and usability of EDRMs. In this paper, we propose a binary code based hash embedding method which allows the size of the embedding table to be reduced in arbitrary scale without compromising too much performance. Experimental evaluation results show that one can still achieve 99\% performance even if the embedding table size is reduced 1000$\times$ smaller than the original one with our proposed method.