title: How to Design Autonomous Service Level Agreements for 6G

abstract: With the growing demand for network connectivity and diversity of network applications, one primary challenge that network service providers are facing is managing the commitments for Service Level Agreements~(SLAs). Service providers typically monitor SLAs for management tasks such as improving their service quality, customer billing and future network planning. Network service customers, on their side, monitor SLAs to optimize network usage and apply, when required, penalties related to service failures. In future 6G networks, critical network applications such as remote surgery and connected vehicles will require these SLAs to be more dynamic, flexible, and automated to match their diverse requirements on network services. Moreover, these SLAs should be transparent to all stakeholders to address the trustworthiness on network services and service providers required by critical applications. Currently, there is no standardised method to immutably record and audit SLAs, leading to challenges in aspects such as SLA enforcement and accountability -- traits essential for future network applications. This work explores new requirements for future service contracts, that is, on the evolution of SLAs. Based on those new requirements, we propose an end to end layered SLA architecture leveraging Distributed Ledger Technology (DLT) and smart contracts. Our architecture is inheritable by an existing telco-application layered architectural frameworks to support future SLAs. We also discuss some limitations of DLT and smart contracts and provide several directions of future studies.


title: eGEN: An Energy-saving Modeling Language and Code Generator for Location-sensing of Mobile Apps

abstract: The demand for reducing the energy consumption of location-based applications has increased in recent years. The abnormal battery-draining behavior of GPS makes it difficult for the developers to decide on battery optimization during the development phase directly. It will reduce the burden on developers if battery-saving strategies are considered early, and relevant battery-aware code is generated from the design phase artifacts. Therefore, we aim to develop tool support, eGEN, to specify and create native location-based mobile apps. eGEN consists of Domain-specific Modeling Language (DSML) and a code generator for location-sensing. It is developed using Xtext and Xtend as an Eclipse plug-in, and currently, it supports native Android apps. eGEN is evaluated through controlled experiments by instrumenting the generated code in five location-based open-source Android applications. The experimental results show 4.35 minutes of average GPS reduction per hour and 188 mA of average reduction in battery consumption while showing only 97 meters degrade in location accuracy over 3 kilometers of a cycling path. Hence, we believe that code generated by eGEN would help developers to balance between energy and accuracy requirements of location-based applications. The source code, documentation, tool demo video, and tool installation video are available at https://github.com/Kowndinya2000/egen.


title: Smooth coarse-graining and colored noise dynamics in stochastic inflation

abstract: We consider stochastic inflation coarse-grained using a general class of exponential filters. Such a coarse-graining prescription gives rise to inflaton-Langevin equations sourced by colored noise that is correlated in $e$-fold time. The dynamics are studied first in slow-roll for simple potentials using first-order perturbative, semi-analytical calculations which are later compared to numerical simulations. Subsequent calculations are performed using an exponentially correlated noise which appears as a leading order correction to the full slow-roll noise correlation functions of the type $\big\langle \xi(N)\xi(N') \big\rangle_{(n)}\sim\left( \cosh\left[ n(N-N')+1 \right] \right)^{-1}$. We find that the power spectrum of curvature perturbations $\mathcal{P}_{\zeta}$ is suppressed at early $e$-folds, with the suppression controlled by $n$. Furthermore, we use the leading order, exponentially correlated noise and perform a first passage time analysis to compute the statistics of the stochastic $e$-fold distribution $\mathcal{N}$ and derive an approximate expression for the mean number of $e$-folds $\big\langle \mathcal{N} \big\rangle$. Comparing analytical results with numerical simulations of the inflaton dynamics, we show that the leading order noise correlation function can be used as a very good approximation of the exact noise, the latter being more difficult to simulate.


title: Ghost diffraction: A spatial statistical approach

abstract: We report the reconstruction of a transparency image in Ghost diffraction scheme using a statistical optics approach. This is implemented by using a static diffuser rather than a pseudo thermal light source with a rotating diffuser. The experimental implementation makes use of spatial ergodicity and spatial stationarity for spatially distributed random fields. A strategy to realize the Ghost diffraction scheme through spatial intensity correlation with a phase retrieval algorithm permits reconstruction of the transparency.


title: Reaction-Path Statistical Mechanics of Enzymatic Kinetics

abstract: We introduce a reaction-path statistical mechanics formalism based on the principle of large deviations to quantify the kinetics of single-molecule enzymatic reaction processes under the Michaelis-Menten mechanism, which exemplifies an out-of-equilibrium process in the living system. Our theoretical approach begins with the principle of equal a priori probabilities and defines the reaction path entropy to construct a new nonequilibrium ensemble as a collection of possible chemical reaction paths. As a result, we evaluate a variety of path-based partition functions and free energies using the formalism of statistical mechanics. They allow us to calculate the timescales of a given enzymatic reaction, even in the absence of an explicit boundary condition that is necessary for the equilibrium ensemble. We also consider the large deviation theory under a closed-boundary condition of the fixed observation time to quantify the enzyme-substrate unbinding rates. The result demonstrates the presence of a phase-separation-like, bimodal behavior in unbinding events at a finite timescale, and the behavior vanishes as its rate function converges to a single phase in the long-time limit.


title: Improving approximate vacuum prepared by the adiabatic quantum computation

abstract: According to the quantum adiabatic theorem, we can in principle obtain a true vacuum of a quantum system starting from a trivial vacuum of a simple Hamiltonian. In actual adiabatic digital quantum simulation with finite time length and non-infinitesimal time steps, we can only obtain an approximate vacuum that is supposed to be a superposition of a true vacuum and excited states. We propose a procedure to improve the approximate vacuum.


title: Automatic Pronunciation Assessment using Self-Supervised Speech Representation Learning

abstract: Self-supervised learning (SSL) approaches such as wav2vec 2.0 and HuBERT models have shown promising results in various downstream tasks in the speech community. In particular, speech representations learned by SSL models have been shown to be effective for encoding various speech-related characteristics. In this context, we propose a novel automatic pronunciation assessment method based on SSL models. First, the proposed method fine-tunes the pre-trained SSL models with connectionist temporal classification to adapt the English pronunciation of English-as-a-second-language (ESL) learners in a data environment. Then, the layer-wise contextual representations are extracted from all across the transformer layers of the SSL models. Finally, the automatic pronunciation score is estimated using bidirectional long short-term memory with the layer-wise contextual representations and the corresponding text. We show that the proposed SSL model-based methods outperform the baselines, in terms of the Pearson correlation coefficient, on datasets of Korean ESL learner children and Speechocean762. Furthermore, we analyze how different representations of transformer layers in the SSL model affect the performance of the pronunciation assessment task.


title: Multi-scale temporal network for continuous sign language recognition

abstract: Continuous Sign Language Recognition (CSLR) is a challenging research task due to the lack of accurate annotation on the temporal sequence of sign language data. The recent popular usage is a hybrid model based on "CNN + RNN" for CSLR. However, when extracting temporal features in these works, most of the methods using a fixed temporal receptive field and cannot extract the temporal features well for each sign language word. In order to obtain more accurate temporal features, this paper proposes a multi-scale temporal network (MSTNet). The network mainly consists of three parts. The Resnet and two fully connected (FC) layers constitute the frame-wise feature extraction part. The time-wise feature extraction part performs temporal feature learning by first extracting temporal receptive field features of different scales using the proposed multi-scale temporal block (MST-block) to improve the temporal modeling capability, and then further encoding the temporal features of different scales by the transformers module to obtain more accurate temporal features. Finally, the proposed multi-level Connectionist Temporal Classification (CTC) loss part is used for training to obtain recognition results. The multi-level CTC loss enables better learning and updating of the shallow network parameters in CNN, and the method has no parameter increase and can be flexibly embedded in other models. Experimental results on two publicly available datasets demonstrate that our method can effectively extract sign language features in an end-to-end manner without any prior knowledge, improving the accuracy of CSLR and achieving competitive results.


title: Frequency Selective Augmentation for Video Representation Learning

abstract: Recent self-supervised video representation learning methods focus on maximizing the similarity between multiple augmented views from the same video and largely rely on the quality of generated views. However, most existing methods lack a mechanism to prevent representation learning from bias towards static information in the video. In this paper, we propose frequency augmentation (FreqAug), a spatio-temporal data augmentation method in the frequency domain for video representation learning. FreqAug stochastically removes specific frequency components from the video so that learned representation captures essential features more from the remaining information for various downstream tasks. Specifically, FreqAug pushes the model to focus more on dynamic features rather than static features in the video via dropping spatial or temporal low-frequency components. To verify the generality of the proposed method, we experiment with FreqAug on multiple self-supervised learning frameworks along with standard augmentations. Transferring the improved representation to five video action recognition and two temporal action localization downstream tasks shows consistent improvements over baselines.


title: Configuration interaction projected density functional theory: effects of four-quasiparticle configurations and time-odd interactions

abstract: The effects of four-quasiparticle configurations and time-odd interactions are investigated in the framework of configuration interaction projected density functional theory by taking the yrast states of 60Fe as examples. Based on the universal PC-PK1 density functional, the energies of the yrast states with spin up to 20\hbar and the available B(E2) transition probabilities are well reproduced. The yrast states are predicted to be of four-quasiparticle structure above spin I = 16\hbar. The inclusion of the time-odd interactions increases the kinetic moments of inertia and delays the appearance of the first band crossing, and, thus, improves the description of the data.


title: Figures of merit for a stochastic gravitational-wave background measurement by LISA: implications of LISA Pathfinder noise correlations

abstract: An important goal of the Laser Interferometer Space Antenna (LISA) is to observe a stochastic gravitational-wave background (SGWB). A study of possible correlated noise in LISA is relevant to establish limits for this future measurement. To test noise investigation methods under somewhat realistic conditions, we use the data of LISA Pathfinder (LPF). We calculate the coherence between the LPF differential acceleration of the two test-masses with magnetic fields, temperature, and micronewton cold gas thruster activity in the spacecraft. We apply our observed correlations to LISA, and estimate how the presence of such correlated noise would affect its search for a SGWB. In the context of a figure of merit, we estimate the effect of noise on the LISA SGWB search.


title: Statistics of biased tracers in variance-suppressed simulations

abstract: Cosmological simulations play an increasingly important role in analysing the observed large-scale structure of the Universe. Recently, they have been particularly important in building hybrid models that combine a perturbative bias expansion with displacement fields extracted from N-body simulations to describe the clustering of biased tracers. Here, we show that simulations that employ a technique referred to as "Fixing-and-pairing" (F&P) can dramatically improve the statistical precision of such hybrid models. Specifically, by numerical and analytic means, we show that F&P simulations provide unbiased estimates for all statistics employed by hybrid models while reducing, by up to two orders of magnitude, their uncertainty on large scales. This roughly implies that an EUCLID-like survey could be analysed using simulations of 2Gpc a side -- a 20% of the survey volume. Our work establishes the robustness of F&P for current hybrid theoretical models for galaxy clustering, an important step towards achieving an optimal exploitation of large-scale structure measurements.


title: Where Does General Relativity Break Down?

abstract: It is widely accepted by physicists and philosophers of physics alike that there are certain contexts in which general relativity will "break down". In such cases, one expects to need some as-yet undiscovered successor theory. This paper will discuss certain pathologies of general relativity that might be taken to signal that the theory is breaking down, and consider how one might expect a successor theory to do better. The upshot will be an unconventional interpretation of the "Strong Cosmic Censorship Hypothesis".


title: A unified treatment of structural definitions on syntax for capture-avoiding substitution, context application, named substitution, partial differentiation, and so on

abstract: We introduce a category-theoreticabstraction of a syntax with auxiliary functions, called an admissiblemonad morphism. Relying on an abstract form of structural recursion,we then design generic tools to construct admissible monad morphismsfrom basic data. These tools automate ubiquitous standard patternslike (1) defining auxiliary functions in successive, potentiallydependent layers, and (2) proving properties of auxiliary functions byinduction on syntax. We cover significant examples from theliterature, including the standard lambda-calculus withcapture-avoiding substitution, a lambda-calculus with bindingevaluation contexts, the lambda-mu-calculus with named substitution, andthe differential lambda-calculus.


title: CrudeOilNews: An Annotated Crude Oil News Corpus for Event Extraction

abstract: In this paper, we present CrudeOilNews, a corpus of English Crude Oil news for event extraction. It is the first of its kind for Commodity News and serve to contribute towards resource building for economic and financial text mining. This paper describes the data collection process, the annotation methodology and the event typology used in producing the corpus. Firstly, a seed set of 175 news articles were manually annotated, of which a subset of 25 news were used as the adjudicated reference test set for inter-annotator and system evaluation. Agreement was generally substantial and annotator performance was adequate, indicating that the annotation scheme produces consistent event annotations of high quality. Subsequently the dataset is expanded through (1) data augmentation and (2) Human-in-the-loop active learning. The resulting corpus has 425 news articles with approximately 11k events annotated. As part of active learning process, the corpus was used to train basic event extraction models for machine labeling, the resulting models also serve as a validation or as a pilot study demonstrating the use of the corpus in machine learning purposes. The annotated corpus is made available for academic research purpose at https://github.com/meisin/CrudeOilNews-Corpus.


title: Controllable Missingness from Uncontrollable Missingness: Joint Learning Measurement Policy and Imputation

abstract: Due to the cost or interference of measurement, we need to control measurement system. Assuming that each variable can be measured sequentially, there exists optimal policy choosing next measurement for the former observations. Though optimal measurement policy is actually dependent on the goal of measurement, we mainly focus on retrieving complete data, so called as imputation. Also, we adapt the imputation method to missingness varying with measurement policy. However, learning measurement policy and imputation requires complete data which is impossible to be observed, unfortunately. To tackle this problem, we propose a data generation method and joint learning algorithm. The main idea is that 1) the data generation method is inherited by imputation method, and 2) the adaptation of imputation encourages measurement policy to learn more than individual learning. We implemented some variations of proposed algorithm for two different datasets and various missing rates. From the experimental results, we demonstrate that our algorithm is generally applicable and outperforms baseline methods.


title: Spatial Transformer Network on Skeleton-based Gait Recognition

abstract: Skeleton-based gait recognition models usually suffer from the robustness problem, as the Rank-1 accuracy varies from 90\% in normal walking cases to 70\% in walking with coats cases. In this work, we propose a state-of-the-art robust skeleton-based gait recognition model called Gait-TR, which is based on the combination of spatial transformer frameworks and temporal convolutional networks. Gait-TR achieves substantial improvements over other skeleton-based gait models with higher accuracy and better robustness on the well-known gait dataset CASIA-B. Particularly in walking with coats cases, Gait-TR get a 90\% Rank-1 gait recognition accuracy rate, which is higher than the best result of silhouette-based models, which usually have higher accuracy than the silhouette-based gait recognition models. Moreover, our experiment on CASIA-B shows that the spatial transformer can extract gait features from the human skeleton better than the widely used graph convolutional network.


title: On-Policy Pixel-Level Grasping Across the Gap Between Simulation and Reality

abstract: Grasp detection in cluttered scenes is a very challenging task for robots. Generating synthetic grasping data is a popular way to train and test grasp methods, as is Dex-net and GraspNet; yet, these methods generate training grasps on 3D synthetic object models, but evaluate at images or point clouds with different distributions, which reduces performance on real scenes due to sparse grasp labels and covariate shift. To solve existing problems, we propose a novel on-policy grasp detection method, which can train and test on the same distribution with dense pixel-level grasp labels generated on RGB-D images. A Parallel-Depth Grasp Generation (PDG-Generation) method is proposed to generate a parallel depth image through a new imaging model of projecting points in parallel; then this method generates multiple candidate grasps for each pixel and obtains robust grasps through flatness detection, force-closure metric and collision detection. Then, a large comprehensive Pixel-Level Grasp Pose Dataset (PLGP-Dataset) is constructed and released; distinguished with previous datasets with off-policy data and sparse grasp samples, this dataset is the first pixel-level grasp dataset, with the on-policy distribution where grasps are generated based on depth images. Lastly, we build and test a series of pixel-level grasp detection networks with a data augmentation process for imbalance training, which learn grasp poses in a decoupled manner on the input RGB-D images. Extensive experiments show that our on-policy grasp method can largely overcome the gap between simulation and reality, and achieves the state-of-the-art performance. Code and data are provided at https://github.com/liuchunsense/PLGP-Dataset.


title: Deterministic, Near-Linear $\varepsilon$-Approximation Algorithm for Geometric Bipartite Matching

abstract: Given point sets $A$ and $B$ in $\mathbb{R}^d$ where $A$ and $B$ have equal size $n$ for some constant dimension $d$ and a parameter $\varepsilon>0$, we present the first deterministic algorithm that computes, in $n\cdot(\varepsilon^{-1} \log n)^{O(d)}$ time, a perfect matching between $A$ and $B$ whose cost is within a $(1+\varepsilon)$ factor of the optimal under any $\smash{\ell_p}$-norm. Although a Monte-Carlo algorithm with a similar running time is proposed by Raghvendra and Agarwal [J. ACM 2020], the best-known deterministic $\varepsilon$-approximation algorithm takes $\Omega(n^{3/2})$ time. Our algorithm constructs a (refinement of a) tree cover of $\mathbb{R}^d$, and we develop several new tools to apply a tree-cover based approach to compute an $\varepsilon$-approximate perfect matching.


title: An STM perspective on hexaborides: Surface states of the Kondo insulator SmB$_6$

abstract: Compounds within the hexaboride class of materials exhibit a wide variety of interesting physical phenomena, including polaron formation and quadrupolar order. In particular, SmB$_6$ has recently drawn attention as it is considered a prototypical topological Kondo insulator. Evidence in favor of this concept, however, has proven experimentally difficult and controversial, partly because of the required temperatures and energy resolution. Here, a powerful tool is Scanning Tunneling Microscopy (STM) with its unique ability to give local, microscopic information that directly relates to the one-particle Green's function. Yet, STM on hexaborides is met with its own set of challenges. This article attempts to review the progress in STM investigations on hexaborides, with emphasis on SmB$_6$ and its intriguing properties.


title: Decoupling Nuclear Spins via Interaction-Induced Freezing in Nitrogen Vacancy Centers in Diamond

abstract: Nitrogen-Vacancy (NV) centers in diamonds provide a room-temperature platform for various emerging quantum technologies, e.g. the long nuclear spin coherence times as potential quantum memory registers. We demonstrate a freezing protocol for an NV center to isolate its intrinsic nuclear spin from a noisy electromagnetic environment. Any initial state of the nuclear spin can be frozen when the hyperfine-coupled electron and nuclear spins are simultaneously driven with unequal Rabi frequencies. Through numerical simulations, we show that our protocol can effectively shield the nuclear spin from strong drive or noise fields. We also observe a clear suppression of quantum correlations in the frozen nuclear spin regime by measuring the quantum discord of the electron-nuclear spin system. These features can be instrumental in extending the storage times of NV nuclear-spin based quantum memories in hybrid quantum systems.


title: Picture Fuzzy Interactional Aggregation Operators via Strict Triangular Norms and Applications to Multi-Criteria Decision Making

abstract: The picture fuzzy set, characterized by three membership degrees, is a helpful tool for multi-criteria decision making (MCDM). This paper investigates the structure of the closed operational laws in the picture fuzzy numbers (PFNs) and proposes efficient picture fuzzy MCDM methods. We first introduce an admissible order for PFNs and prove that all PFNs form a complete lattice under this order. Then, we give some specific examples to show the non-closeness of some existing picture fuzzy aggregation operators. To ensure the closeness of the operational laws in PFNs, we construct a new class of picture fuzzy operators based on strict triangular norms, which consider the interaction between the positive degrees (negative degrees) and the neutral degrees. Based on these new operators, we obtain the picture fuzzy interactional weighted average (PFIWA) operator and the picture fuzzy interactional weighted geometric (PFIWG) operator. They are proved to be monotonous, idempotent, bounded, shift-invariant, and homogeneous. We also establish a novel MCDM method under the picture fuzzy environment applying PFIWA and PFIWG operators. Furthermore, we present an illustrative example for a clear understanding of our method. We also give the comparative analysis among the operators induced by six classes of famous triangular norms.


title: A Study of Different Ways to Use The Conformer Model For Spoken Language Understanding

abstract: SLU combines ASR and NLU capabilities to accomplish speech-to-intent understanding. In this paper, we compare different ways to combine ASR and NLU, in particular using a single Conformer model with different ways to use its components, to better understand the strengths and weaknesses of each approach. We find that it is not necessarily a choice between two-stage decoding and end-to-end systems which determines the best system for research or application. System optimization still entails carefully improving the performance of each component. It is difficult to prove that one direction is conclusively better than the other. In this paper, we also propose a novel connectionist temporal summarization (CTS) method to reduce the length of acoustic encoding sequences while improving the accuracy and processing speed of end-to-end models. This method achieves the same intent accuracy as the best two-stage SLU recognition with complicated and time-consuming decoding but does so at lower computational cost. This stacked end-to-end SLU system yields an intent accuracy of 93.97% for the SmartLights far-field set, 95.18% for the close-field set, and 99.71% for FluentSpeech.


title: CD$^2$-pFed: Cyclic Distillation-guided Channel Decoupling for Model Personalization in Federated Learning

abstract: Federated learning (FL) is a distributed learning paradigm that enables multiple clients to collaboratively learn a shared global model. Despite the recent progress, it remains challenging to deal with heterogeneous data clients, as the discrepant data distributions usually prevent the global model from delivering good generalization ability on each participating client. In this paper, we propose CD^2-pFed, a novel Cyclic Distillation-guided Channel Decoupling framework, to personalize the global model in FL, under various settings of data heterogeneity. Different from previous works which establish layer-wise personalization to overcome the non-IID data across different clients, we make the first attempt at channel-wise assignment for model personalization, referred to as channel decoupling. To further facilitate the collaboration between private and shared weights, we propose a novel cyclic distillation scheme to impose a consistent regularization between the local and global model representations during the federation. Guided by the cyclical distillation, our channel decoupling framework can deliver more accurate and generalized results for different kinds of heterogeneity, such as feature skew, label distribution skew, and concept shift. Comprehensive experiments on four benchmarks, including natural image and medical image analysis tasks, demonstrate the consistent effectiveness of our method on both local and external validations.


title: Bialgebras overs another bialgebras and quasishuffle double bialgebras

abstract: Quasishuffle Hopf algebras, usually defined on a commutative monoid, can be more generally defined on any associative algebra V. If V is a commutative and cocommutative bialgebra, the associated quasishuffle bialgebra QSh(V) inherits a second coproduct $\delta$ of contraction and extraction of words, cointeracting with the deconcatenation coproduct $\Delta$, making QSh(V) a double bialgebra. In order to generalize the universal property of the Hopf algebra of quasisymmetric functions QSym (a particular case of quasishuffle Hopf algebra) as exposed by Aguiar, Bergeron and Sottile, we introduce the notion of double bialgebra over V. A bialgebra over V is a bialgebra in the category of right V-comodules and an extra condition is required on the second coproduct for double bialgebras over V. We prove that the quasishuffle bialgebra QSh(V) is a double bialgebra over V , and that it satisfies a universal property: for any bialgebra B over V and for any character $\lambda$ of B, under a connectedness condition, there exists a unique morphism $\phi$ of bialgebras over V from B to QSh(V) such that $\epsilon_\delta \circ \phi=\lambda$. When V is a double bialgebra over V , we obtain a unique morphism of double bialgebras over V from B to QSh(V), and show that this morphism $\phi_1$ allows to obtain any morphism of bialgebra over V from B to QSh(V) thanks to an action of a monoid of characters. This formalism is applied to a double bialgebra of V-decorated graphs.


title: About Opposition and Duality in Paraconsistent Type Theory

abstract: A paraconsistent type theory (an extension of a fragment of intuitionistic type theory by adding opposite types) is here extended by adding co-function types. It is shown that, in the extended paraconsistent type system, the opposite type constructor can be viewed as an involution operation that transforms each type into its dual type. Moreover, intuitive interpretations of opposite and co-function types under different interpretations of types are discussed.


title: Vision Transformers for Single Image Dehazing

abstract: Image dehazing is a representative low-level vision task that estimates latent haze-free images from hazy images. In recent years, convolutional neural network-based methods have dominated image dehazing. However, vision Transformers, which has recently made a breakthrough in high-level vision tasks, has not brought new dimensions to image dehazing. We start with the popular Swin Transformer and find that several of its key designs are unsuitable for image dehazing. To this end, we propose DehazeFormer, which consists of various improvements, such as the modified normalization layer, activation function, and spatial information aggregation scheme. We train multiple variants of DehazeFormer on various datasets to demonstrate its effectiveness. Specifically, on the most frequently used SOTS indoor set, our small model outperforms FFA-Net with only 25% #Param and 5% computational cost. To the best of our knowledge, our large model is the first method with the PSNR over 40 dB on the SOTS indoor set, dramatically outperforming the previous state-of-the-art methods. We also collect a large-scale realistic remote sensing dehazing dataset for evaluating the method's capability to remove highly non-homogeneous haze.


title: SeCaV: A Sequent Calculus Verifier in Isabelle/HOL

abstract: We describe SeCaV, a sequent calculus verifier for first-order logic in Isabelle/HOL, and the SeCaV Unshortener, an online tool that expands succinct derivations into the full SeCaV syntax. We leverage the power of Isabelle/HOL as a proof checker for our SeCaV derivations. The interactive features of Isabelle/HOL make our system transparent. For instance, the user can simply click on a side condition to see its exact definition. Our formalized soundness and completeness proofs pertain exactly to the calculus as exposed to the user and not just to some model of our tool. Users can also write their derivations in the SeCaV Unshortener, which provides a lighter syntax, and expand them for later verification. We have used both tools in our teaching.


title: A Quick Overview on the Quantum Control Approach to the Lambda Calculus

abstract: In this short overview, we start with the basics of quantum computing, explaining the difference between the quantum and the classical control paradigms. We give an overview of the quantum control line of research within the lambda calculus, ranging from untyped calculi up to categorical and realisability models. This is a summary of the last 10+ years of research in this area, starting from Arrighi and Dowek's seminal work until today.


title: Trapping a Free-propagating Single-photon into an Atomic Ensemble as a Quantum Stationary Light Pulse

abstract: Efficient photon-photon interaction is one of the key elements for realizing quantum information processing. The interaction, however, must often be mediated through an atomic medium due to the bosonic nature of photons, and the interaction time, which is critically linked to the efficiency, depends on the properties of the atom-photon interaction. While the electromagnetically induced transparency effect does offer the possibility of photonic quantum memory, it does not enhance the interaction time as it fully maps the photonic state to an atomic state. The stationary light pulse (SLP) effect, on the contrary, traps the photonic state inside an atomic medium with zero group velocity, opening up the possibility of the enhanced interaction time. In this work, we report the first experimental demonstration of trapping a free-propagating single-photon into a cold atomic ensemble via the quantum SLP (QSLP) process. We conclusively show that the quantum properties of the single-photon state are preserved well during the QSLP process. Our work paves the way to new approaches for efficient photon-photon interactions, exotic photonic states, and many-body simulations in photonic systems.


title: Uniformly Valid Inference Based on the Lasso in Linear Mixed Models

abstract: Linear mixed models (LMMs) are suitable for clustered data and are common in biometrics, medicine, survey statistics and many other fields. In those applications, it is essential to carry out valid inference after selecting a subset of the available variables. We construct confidence sets for the fixed effects in Gaussian LMMs that are based on Lasso-type estimators. Aside from providing confidence regions, this also allows to quantify the joint uncertainty of both variable selection and parameter estimation in the procedure. To show that the resulting confidence sets for the fixed effects are uniformly valid over the parameter spaces of both the regression coefficients and the covariance parameters, we also prove the novel result on uniform Cramer consistency of the restricted maximum likelihood (REML) estimators of the covariance parameters. The superiority of the constructed confidence sets to naive post-selection procedures is validated in simulations and illustrated with a study of the acid neutralization capacity of lakes in the United States.


title: Transducer-based language embedding for spoken language identification

abstract: The acoustic and linguistic features are important cues for the spoken language identification (LID) task. Recent advanced LID systems mainly use acoustic features that lack the usage of explicit linguistic feature encoding. In this paper, we propose a novel transducer-based language embedding approach for LID tasks by integrating an RNN transducer model into a language embedding framework. Benefiting from the advantages of the RNN transducer's linguistic representation capability, the proposed method can exploit both phonetically-aware acoustic features and explicit linguistic features for LID tasks. Experiments were carried out on the large-scale multilingual LibriSpeech and VoxLingua107 datasets. Experimental results showed the proposed method significantly improves the performance on LID tasks with 12% to 59% and 16% to 24% relative improvement on in-domain and cross-domain datasets, respectively.


title: Adding Connectionist Temporal Summarization into Conformer to Improve Its Decoder Efficiency For Speech Recognition

abstract: The Conformer model is an excellent architecture for speech recognition modeling that effectively utilizes the hybrid losses of connectionist temporal classification (CTC) and attention to train model parameters. To improve the decoding efficiency of Conformer, we propose a novel connectionist temporal summarization (CTS) method that reduces the number of frames required for the attention decoder fed from the acoustic sequences generated by the encoder, thus reducing operations. However, to achieve such decoding improvements, we must fine-tune model parameters, as cross-attention observations are changed and thus require corresponding refinements. Our final experiments show that, with a beamwidth of 4, the LibriSpeech's decoding budget can be reduced by up to 20% and for FluentSpeech data it can be reduced by 11%, without losing ASR accuracy. An improvement in accuracy is even found for the LibriSpeech "test-other" set. The word error rate (WER) is reduced by 6\% relative at the beam width of 1 and by 3% relative at the beam width of 4.


title: Inelastic Cotunneling Resonances in the Coulomb-Blockade Transport in Donor-Atom Transistors

abstract: We report finite-bias characteristics of electrical transport through phosphorus donors in silicon nanoscale transistors, in which we observe inelastic-cotunneling current in the Coulomb blockade region. The cotunneling current appears like a resonant-tunneling current peak emerging from the excited state at the crossover between blockade and non-blockade regions. These cotunneling features are unique, since the inelastic-cotunneling currents have so far been reported either as a broader hump or as a continuous increment of current. This finding is ascribed purely due to excitation-related inelastic cotunneling involving the ground and excited states. Theoretical calculations were performed for a two-level quantum dot, supporting our experimental observation.


title: Direct measurement of atomic entanglement via cavity photon statistics

abstract: We propose an experimental scheme for the measurement of entanglement between two two-level atoms. Our scheme requires one of the two entangled atoms to interact with a cavity field dispersively, and we show that by measuring the zero time-delay second-order coherence function of the cavity field, one can measure the concurrence of an arbitrary Bell-like atomic two-qubit state. As our scheme requires only one of the atoms to interact with the measured cavity, the entanglement quantification becomes independent of the location of the other atom. Therefore, our scheme can have important implications for entanglement quantification in distributed quantum systems.


title: A note on one-sided recognizable morphisms

abstract: We revisit the notion of one-sided recognizability of morphisms and its relation to two-sided recognizability.


title: On the fast assemblage of finite element matrices with application to nonlinear heat transfer problems

abstract: The finite element method is a well-established method for the numerical solution of partial differential equations (PDEs), both linear and nonlinear. However, the repeated reassemblage of finite element matrices for nonlinear PDEs is frequently pointed out as one of the bottlenecks in the computations. The second bottleneck being the large and numerous linear systems to be solved arising from the use of Newton's method to solve nonlinear systems of equations. In this paper, we will address the first issue. We will see how under mild assumptions the assemblage procedure may be rewritten using a completely loop-free algorithm. Our approach leads to a small matrix-matrix multiplication for which we may count on highly optimized algorithms.


title: Quantifying relation between mobility patterns and socioeconomic status of dockless sharing-bike users

abstract: Bikes are among the healthiest, greenest, and most affordable means of transportation for a better future city, but mobility patterns of riders with different income were rarely studied due to limitations on collecting data. Newly emergent dockless bike-sharing platforms that record detailed information regarding each trip provide us a unique opportunity. Attribute to its better usage flexibility and accessibility, dockless bike-sharing platforms are booming over the past a few years worldwide and reviving the riding fashion in cities. In this work, by exploiting massive riding records in two megacities from a dockless bike-sharing platform, we reveal that individual mobility patterns, including radius of gyration and average travel distance, are similar among users with different income, which indicates that human beings all follow similar physical rules. However, collective mobility patterns, including average range and diversity of visitation, and commuting directions, all exhibit different behaviors and spatial patterns across income categories. Hotspot locations that attract more cycling activities are quite different over groups, and locations where users reside are of a low user ratio for both higher and lower income groups. Lower income groups are inclined to visit less flourishing locations, and commute towards the direction to the city center in both cities, and of a smaller mobility diversity in Beijing but a larger diversity in Shanghai. In addition, differences on mobility patterns among socioeconomic categories are more evident in Beijing than in Shanghai. Our findings would be helpful on designing better promotion strategies for dockless bike-sharing platforms and towards the transition to a more sustainable green transportation.


title: SoundBeam: Target sound extraction conditioned on sound-class labels and enrollment clues for increased performance and continuous learning

abstract: In many situations, we would like to hear desired sound events (SEs) while being able to ignore interference. Target sound extraction (TSE) tackles this problem by estimating the audio signal of the sounds of target SE classes in a mixture of sounds while suppressing all other sounds. We can achieve this with a neural network that extracts the target SEs by conditioning it on clues representing the target SE classes. Two types of clues have been proposed, i.e., target SE class labels and enrollment audio samples (or audio queries), which are pre-recorded audio samples of sounds from the target SE classes. Systems based on SE class labels can directly optimize embedding vectors representing the SE classes, resulting in high extraction performance. However, extending these systems to extract new SE classes not encountered during training is not easy. Enrollment-based approaches extract SEs by finding sounds in the mixtures that share similar characteristics to the enrollment audio samples. These approaches do not explicitly rely on SE class definitions and can thus handle new SE classes. In this paper, we introduce a TSE framework, SoundBeam, that combines the advantages of both approaches. We also perform an extensive evaluation of the different TSE schemes using synthesized and real mixtures, which shows the potential of SoundBeam.


title: Advancing Semi-Supervised Learning for Automatic Post-Editing: Data-Synthesis by Mask-Infilling with Erroneous Terms

abstract: Semi-supervised learning that leverages synthetic data for training has been widely adopted for developing automatic post-editing (APE) models due to the lack of training data. With this aim, we focus on data-synthesis methods to create high-quality synthetic data. Given that APE takes as input a machine-translation result that might include errors, we present a data-synthesis method by which the resulting synthetic data mimic the translation errors found in actual data. We introduce a noising-based data-synthesis method by adapting the masked language model approach, generating a noisy text from a clean text by infilling masked tokens with erroneous tokens. Moreover, we propose selective corpus interleaving that combines two separate synthetic datasets by taking only the advantageous samples to enhance the quality of the synthetic data further. Experimental results show that using the synthetic data created by our approach results in significantly better APE performance than other synthetic data created by existing methods.


title: Sim-to-Real Transfer of Compliant Bipedal Locomotion on Torque Sensor-Less Gear-Driven Humanoid

abstract: Sim-to-real is a mainstream method to cope with the large number of trials needed by typical deep reinforcement learning methods. However, transferring a policy trained in simulation to actual hardware remains an open challenge due to the reality gap. In particular, the characteristics of actuators in legged robots have a considerable influence on sim-to-real transfer. There are two challenges: 1) High reduction ratio gears are widely used in actuators, and the reality gap issue becomes especially pronounced when backdrivability is considered in controlling joints compliantly. 2) The difficulty in achieving stable bipedal locomotion causes typical system identification methods to fail to sufficiently transfer the policy. For these two challenges, we propose 1) a new simulation model of gears and 2) a method for system identification that can utilize failed attempts. The method's effectiveness is verified using a biped robot, the ROBOTIS-OP3, and the sim-to-real transferred policy can stabilize the robot under severe disturbances and walk on uneven surfaces without using force and torque sensors.


title: Exploring Transformer's potential on automatic piano transcription

abstract: Most recent research about automatic music transcription (AMT) uses convolutional neural networks and recurrent neural networks to model the mapping from music signals to symbolic notation. Based on a high-resolution piano transcription system, we explore the possibility of incorporating another powerful sequence transformation tool -- the Transformer -- to deal with the AMT problem. We argue that the properties of the Transformer make it more suitable for certain AMT subtasks. We confirm the Transformer's superiority on the velocity detection task by experiments on the MAESTRO dataset and a cross-dataset evaluation on the MAPS dataset. We observe a performance improvement on both frame-level and note-level metrics after introducing the Transformer network.


title: Optimizing Coordinative Schedules for Tanker Terminals: An Intelligent Large Spatial-Temporal Data-Driven Approach -- Part 1

abstract: In this study, a novel coordinative scheduling optimization approach is proposed to enhance port efficiency by reducing average wait time and turnaround time. The proposed approach consists of enhanced particle swarm optimization (ePSO) as kernel and augmented firefly algorithm (AFA) as global optimal search. Two paradigm methods of the proposed approach are investigated, which are batch method and rolling horizon method. The experimental results show that both paradigm methods of proposed approach can effectively enhance port efficiency. The average wait time could be significantly reduced by 86.0% - 95.5%, and the average turnaround time could eventually save 38.2% - 42.4% with respect to historical benchmarks. Moreover, the paradigm method of rolling horizon could reduce to 20 mins on running time over 3-month datasets, rather than 4 hrs on batch method at corresponding maximum performance.


title: The insidious bicategory of algebra bundles

abstract: In this paper we construct a bicategory of (super) algebra bundles over a smooth manifold, where the 1-morphisms are bundles of bimodules. The main point is that naive definitions of bimodule bundles will not lead to a well-defined composition law in such a bicategory, at least not if non-invertible bimodules and non-semisimple algebras are desired. This problem has not been addressed so far in the literature. We develop a complete solution, and also address symmetric monoidal structures as well as the corresponding questions of dualizability.


title: Dragged surfaces. On the accretion tori in the ergoregion

abstract: We discuss the conditions for the existence of extended matter configurations orbiting in the ergoregion or close to the outer ergosurface of the Kerr black hole ("dragged" configurations). The corotating tori under consideration are perfect fluid configurations with barotropic equation of state, orbiting on the equatorial plane of the central Kerr black hole. The possibility of magnetized tori with a toroidal magnetic field is also discussed. Indications on the attractors where dragged tori can be observed are provided with the analysis of the fluid characteristics and geometrical features, relevant for the tori stability and their observations. QPOs emissions from the inner edges of the dragged tori are also discussed. We argue that the smaller dragged tori could be subjected to a characteristic instability, effect of the frame-dragging. This possibility is thoroughly explored. This can finally lead to the destruction of the torus (disk exfoliation) which can combine with accretion and processes present in the regions very close to the black hole horizon. Tori are characterized according to the central attractor dimensionless spin. These structures can be observed orbiting black holes with dimensionless spin a > 0.9897M.


title: Minimal subsystems of given mean dimension in Bernstein spaces

abstract: In this paper, we study the shift on the space of uniformly bounded continuous functions band-limited in a given compact interval with the standard topology of tempered distributions. We give a constructive proof of the existence of minimal subsystems with any given mean dimension strictly less than twice its band-width. A version of real-valued function spaces is considered as well.


title: On Presburger arithmetic extended with non-unary counting quantifiers

abstract: We consider a first-order logic for the integers with addition. This logic extends classical first-order logic by modulo-counting, threshold-counting and exact-counting quantifiers, all applied to tuples of variables (here, residues are given as terms while moduli and thresholds are given explicitly). Our main result shows that satisfaction for this logic is decidable in two-fold exponential space. If only threshold- and exact-counting quantifiers are allowed, we prove an upper bound of alternating two-fold exponential time with linearly many alternations. This latter result almost matches Berman's exact complexity of first-order logic without counting quantifiers. To obtain these results, we first translate threshold- and exact-counting quantifiers into classical first-order logic in polynomial time (which already proves the second result). To handle the remaining modulo-counting quantifiers for tuples, we first reduce them in doubly exponential time to modulo-counting quantifiers for single elements. For these quantifiers, we provide a quantifier elimination procedure similar to Reddy and Loveland's procedure for first-order logic and analyse the growth of coefficients, constants, and moduli appearing in this process. The bounds obtained this way allow to restrict quantification in the original formula to integers of bounded size which then implies the first result mentioned above. Our logic is incomparable with the logic considered by Chistikov et al. in 2022. They allow more general counting operations in quantifiers, but only unary quantifiers. The move from unary to non-unary quantifiers is non-trivial, since, e.g., the non-unary version of the H\"artig quantifier results in an undecidable theory.


title: Taylor Estimates for the laws of pinned Bessel bridges, and Integration by Parts

abstract: In this article, we extend the integration by parts formulae for the laws of Bessel bridges obtained in previous work with Zambotti, by showing that these formulae hold for very general test functionals on $L^{2}(0,1)$. A key step consists in establishing new Taylor estimates on the laws of pinned Bessel bridges.


title: BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model

abstract: Pretrained language models have served as important backbones for natural language processing. Recently, in-domain pretraining has been shown to benefit various domain-specific downstream tasks. In the biomedical domain, natural language generation (NLG) tasks are of critical importance, while understudied. Approaching natural language understanding (NLU) tasks as NLG achieves satisfying performance in the general domain through constrained language generation or language prompting. We emphasize the lack of in-domain generative language models and the unsystematic generative downstream benchmarks in the biomedical domain, hindering the development of the research community. In this work, we introduce the generative language model BioBART that adapts BART to the biomedical domain. We collate various biomedical language generation tasks including dialogue, summarization, entity linking, and named entity recognition. BioBART pretrained on PubMed abstracts has enhanced performance compared to BART and set strong baselines on several tasks. Furthermore, we conduct ablation studies on the pretraining tasks for BioBART and find that sentence permutation has negative effects on downstream tasks.


title: Superexchange Liquefaction of Strongly Correlated Lattice Dipolar Bosons

abstract: We propose a mechanism for liquid formation in strongly correlated lattice systems. The mechanism is based on an interplay between long-range attraction and superexchange processes. As an example, we study dipolar bosons in one-dimensional optical lattices. We present a perturbative theory and validate it in comparison with full density-matrix renormalization group simulations for the energetic and structural properties of different phases of the system, i.e., self-bound Mott insulator, liquid, and gas. We analyze the nonequilibrium properties and calculate the dynamic structure factor. Its structure differs in compressible and insulating phases. In particular, the low-energy excitations in compressible phases are linear phonons. We extract the speed of sound and analyze its dependence on dipolar interaction and density. We show that it exhibits a nontrivial behaviour owing to the breaking of Galilean invariance. We argue that an experimental detection of this previously unknown quantum liquid could provide a fingerprint of the superexchange process and open intriguing possibilities for investigating non-Galilean invariant liquids.


title: On the considerations adopted by Breidze and Traczyk towards the faithfulness of Burau representation for $n=4$

abstract: This work discusses the open problem of the faithfulness of the reduced Burau representation for $n=4$. Birman showed that in order to prove this representation is faithful, it is sufficient to find two matrices $A$ and $B$ that generate a free group of rank 2. Breidze and Traczyk proved that $A^{3}$ and $B^{3}$ generate the free group of rank 2. In our work, we show that $A^{2}$ and $B^{2}$ generate the free group of rank 2.


title: Second-order differential equation with indefinite and repulsive singularities

abstract: This paper concerns a second-order differential equation with indefinite and repulsive singularities. It is the first time to study differential equation containing both indefinite and repulsive singularities simultaneously. A set of sufficient conditions are obtained for the existence of positive periodic solutions. The theoretical underpinnings of this paper are the positivity of Green's function and fixed point theorem in cones. Our results improve and extend the results in previous literatures. Finally, three examples and their numerical simulations (phase diagrams and time diagrams of periodic solutions) are given to show the effectiveness of our conclusions.


title: On the $ P_3 $-hull numbers of $ q $-Kneser graphs and Grassmann graphs

abstract: Let $S$ be an $n$-dimensional vector space over the finite field $\mathbb{F}_q$, where $q$ is necessarily a prime power. Denote $K_q(n,k)$ (resp. $J_q(n,k)$) to be the \emph{$q$-Kneser graph} (resp. \emph{Grassmann graph}) for $k\geq 1$ whose vertices are the $k$-dimensional subspaces of $S$ and two vertices $v_1$ and $v_2$ are adjacent if $\dim(v_1\cap v_2)=0$ (resp. $\dim(v_1\cap v_2)=k-1$). We consider the infection spreading in the $ q $-Kneser graphs and the Grassmann graphs: a vertex gets infected if it has at least two infected neighbors. In this paper, we compute the $ P_3 $-hull numbers of $K_q(n,k)$ and $J_q(n,k)$ respectively, which is the minimum size of a vertex set that eventually infects the whole graph.


title: Generic Stability and Modes of Convergence

abstract: We study generically stable types/measures in both classical and continuous logics, and their connection with randomization and modes of convergence of types/measures.


title: A posteriori learning for quasi-geostrophic turbulence parametrization

abstract: The use of machine learning to build subgrid parametrizations for climate models is receiving growing attention. State-of-the-art strategies address the problem as a supervised learning task and optimize algorithms that predict subgrid fluxes based on information from coarse resolution models. In practice, training data are generated from higher resolution numerical simulations transformed in order to mimic coarse resolution simulations. By essence, these strategies optimize subgrid parametrizations to meet so-called $\textit{a priori}$ criteria. But the actual purpose of a subgrid parametrization is to obtain good performance in terms of $\textit{a posteriori}$ metrics which imply computing entire model trajectories. In this paper, we focus on the representation of energy backscatter in two dimensional quasi-geostrophic turbulence and compare parametrizations obtained with different learning strategies at fixed computational complexity. We show that strategies based on $\textit{a priori}$ criteria yield parametrizations that tend to be unstable in direct simulations and describe how subgrid parametrizations can alternatively be trained end-to-end in order to meet $\textit{a posteriori}$ criteria. We illustrate that end-to-end learning strategies yield parametrizations that outperform known empirical and data-driven schemes in terms of performance, stability and ability to apply to different flow configurations. These results support the relevance of differentiable programming paradigms for climate models in the future.


title: Optical Signatures of the Coupling between Excitons and Charge Transfer States in Linear Molecular Aggregates

abstract: Charge Transfer (CT) has enjoyed continuous interest due to increasing experimental control over molecular structure leading to applications in, for example, photovoltaics and hydrogen production. In this paper, we investigate the effect of CT states on the absorption spectrum of linear molecular aggregates using a scattering matrix technique that allows us to deal with arbitrarily large systems. The presented theory performs well for both strong and weak mixing of exciton and CT states, bridging the gap between previously employed methods which are applicable in only one of these limits. In experimental spectra the homogeneous linewidth is often too large to resolve all optically allowed transitions individually, resulting in a characteristic two-peak absorption spectrum in both the weak- and strong-coupling regime. Using the scattering matrix technique we examine the contributions of free and bound states in detail. We conclude that the skewness of the high-frequency peak may be used as a new way to identify the exciton-CT-state coupling strength.


title: Stability of Non-linear Neural Feedback Loops using Sum of Squares

abstract: Neural network controllers have the potential to improve the performance of feedback systems compared to traditional controllers, due to their ability to act as general function approximators. However, quantifying their safety and robustness properties has proven challenging due to the non-linearities of the activation functions inside the neural network. A key robustness indicator is certifying the stability properties of the feedback system and providing a region of attraction, which has been addressed in previous literature. However, these works only address linear systems or require one to abstract the plant non-linearities and bound them using slope and sector constraints. In this paper we use a Sum of Squares programming framework to compute the stability of non-linear systems with neural network controllers directly. Within this framework, we can propose higher order candidate Lyapunov functions with richer structures that are able to better capture the dynamics of the non-linear system and the nonlinearities in the neural network. We are also able to analyse these systems in continuous time, whereas other methods rely on discretising the system. These higher order Lyapunov functions are used in conjunction with higher order multipliers on the inequality and equality constraints that bound the neural network input-output properties. The volume of the region of attraction computed is increased compared to other methods, allowing for better safety guarantees on the stability of the system. We are also able to easily analyse non-linear polynomial systems, which is not possible to do with other methods. We are also able to conduct robustness analysis on the parameter uncertainty. We show the benefits of our method using numerical examples.


title: Revealing A Trans-Planckian World Solves The Cosmological Constant Problem

abstract: The Planck scale is usually believed to be an unpassable wall. Putting a cutoff there and thinking of it as a quantized spacetime entity shows that. However, this is exactly the cause of many problems in quantum gravity. The cosmological constant problem also comes down to the problem of how to describe a trans-Planckian world by a continuum theory that shall be renormalizable and background free. Here, we show that when quantizing gravity in a diffeomorphism-invariant method, in which background freedom arises asymptotically as an exact conformal symmetry, the zero-point energy vanishes identically. Thus, there is no problem with the cosmological constant, which is a physical constant, namely a renormalization group invariant. We also argue that new quanta based on the background freedom emerge and spacetime is discretized dynamically. Primordial fluctuations will originate from such quanta.


title: A model in which the Separation principle holds for a given effective projective Sigma-class

abstract: In this paper, we prove the following: If $n\ge3$, there is a generic extension of $L$ -- the constructible universe -- in which it is true that the Separation principle holds for both effective (lightface) classes $\varSigma^1_n$ and $\varPi^1_n$ for sets of integers. The result was announced long ago by Leo Harrington with a sketch of the proof for $n=3$; its full proof has never been presented. Our methods are based on a countable product of almost-disjoint forcing notions independent in the sense of Jensen--Solovay.


title: A Survey of Supernet Optimization and its Applications: Spatial and Temporal Optimization for Neural Architecture Search

abstract: This survey focuses on categorizing and evaluating the methods of supernet optimization in the field of Neural Architecture Search (NAS). Supernet optimization involves training a single, over-parameterized network that encompasses the search space of all possible network architectures. The survey analyses supernet optimization methods based on their approaches to spatial and temporal optimization. Spatial optimization relates to optimizing the architecture and parameters of the supernet and its subnets, while temporal optimization deals with improving the efficiency of selecting architectures from the supernet. The benefits, limitations, and potential applications of these methods in various tasks and settings, including transferability, domain generalization, and Transformer models, are also discussed.


title: In situ controllable magnetic phases in doped twisted bilayer transition-metal dichalcogenides

abstract: We study the electronic structure of hole-doped transition metal dichalcogenides for small twist-angels, where the onsite repulsion is extremely strong. Using unbiased diagrammatic Monte Carlo simulations, we find evidence for magnetic correlations which are driven by delocalization and can be controlled in situ via the dielectric environment. For weak spin-orbit coupling, we find that the moderately doped system becomes anti-ferromagnetic, whilst the regime of strong spin-orbit coupling features ferromagnetic correlations. We show that this behavior is accurately predicted by an analytical theory based on moment expansion of the Hamiltonian, and analysis of corresponding particle trajectories.


title: The Duality of SONC: Advances in Circuit-based Certificates

abstract: The cone of sums of nonnegative circuits (SONCs) is a subset of the cone of nonnegative polynomials / exponential sums, which has been studied extensively in recent years. In this article, we construct a subset of the SONC cone which we call the DSONC cone. The DSONC cone can be seen as an extension of the dual SONC cone; membership can be tested via linear programming. We show that the DSONC cone is a proper, full-dimensional cone, we provide a description of its extreme rays, and collect several properties that parallel those of the SONC cone. Moreover, we show that functions in the DSONC cone cannot have real zeros, which yields that DSONC cone does not intersect the boundary of the SONC cone. Furthermore, we discuss the intersection of the DSONC cone with the SOS and SDSOS cones. Finally, we show that circuit functions in the boundary of the DSONC cone are determined by points of equilibria, which hence are the analogues to singular points in the primal SONC cone, and relate the DSONC cone to tropical geometry.


title: Network Shuffling: Privacy Amplification via Random Walks

abstract: Recently, it is shown that shuffling can amplify the central differential privacy guarantees of data randomized with local differential privacy. Within this setup, a centralized, trusted shuffler is responsible for shuffling by keeping the identities of data anonymous, which subsequently leads to stronger privacy guarantees for systems. However, introducing a centralized entity to the originally local privacy model loses some appeals of not having any centralized entity as in local differential privacy. Moreover, implementing a shuffler in a reliable way is not trivial due to known security issues and/or requirements of advanced hardware or secure computation technology. Motivated by these practical considerations, we rethink the shuffle model to relax the assumption of requiring a centralized, trusted shuffler. We introduce network shuffling, a decentralized mechanism where users exchange data in a random-walk fashion on a network/graph, as an alternative of achieving privacy amplification via anonymity. We analyze the threat model under such a setting, and propose distributed protocols of network shuffling that is straightforward to implement in practice. Furthermore, we show that the privacy amplification rate is similar to other privacy amplification techniques such as uniform shuffling. To our best knowledge, among the recently studied intermediate trust models that leverage privacy amplification techniques, our work is the first that is not relying on any centralized entity to achieve privacy amplification.


title: Global Update Guided Federated Learning

abstract: Federated learning protects data privacy and security by exchanging models instead of data. However, unbalanced data distributions among participating clients compromise the accuracy and convergence speed of federated learning algorithms. To alleviate this problem, unlike previous studies that limit the distance of updates for local models, we propose global-update-guided federated learning (FedGG), which introduces a model-cosine loss into local objective functions, so that local models can fit local data distributions under the guidance of update directions of global models. Furthermore, considering that the update direction of a global model is informative in the early stage of training, we propose adaptive loss weights based on the update distances of local models. Numerical simulations show that, compared with other advanced algorithms, FedGG has a significant improvement on model convergence accuracies and speeds. Additionally, compared with traditional fixed loss weights, adaptive loss weights enable our algorithm to be more stable and easier to implement in practice.


title: Mixed lattice structures and cone projections

abstract: Problems related to projections on closed convex cones are frequently encountered in optimization theory and related fields. To study these problems, various unifying ideas have been introduced, including asymmetric vector-valued norms and certain generalized lattice-like operations. We propose a new perspective on these studies by describing how the problem of cone projection can be formulated using an order-theoretic formalism developed in this paper. The underlying mathematical structure is a partially ordered vector space that generalizes the notion of a vector lattice by using two partial orderings and having certain lattice-type properties with respect to these orderings. In this note we introduce a generalization of these so-called mixed lattice spaces, and we show how such structures arise quite naturally in some of the applications mentioned above.


title: A Library of Synthetic X-ray Spectra for Fitting Tidal Disruption Events

abstract: We present a tabulated version of our slim disk model for fitting tidal disruption events (TDEs). We create a synthetic X-ray spectral library by ray-tracing stationary general relativistic slim disks and including gravitational redshift, Doppler, and lensing effects self-consistently. We introduce the library to reduce computational expense and increase access for fitting future events. Fitting requires interpolation between the library spectra; the interpolation error in the synthetic flux is generally $<10\%$ (it can rise to $40\%$ when the disk is nearly edge-on). We fit the X-ray spectra of the TDEs ASASSN-14li and ASASSN-15oi, successfully reproducing our earlier constraints on black hole mass $M_\bullet$ and spin $a_\bullet$ from full on-the-fly ray-tracing. We use the library to fit mock observational data to explore the degeneracies among parameters, finding that 1) hotter thermal disk and edge-on inclination angle spectra offer tighter constraints on $M_\bullet$ and $a_\bullet$; 2) the constraining power of spectra on $M_\bullet$ and $a_\bullet$ increases as a power-law with the number of X-ray counts, and the index of the power law is higher for hotter thermal disk spectra; 3) multi-epoch X-ray spectra partially break the degeneracy between $M_\bullet$ and $a_\bullet$; 4) the time-dependent level of X-ray absorption can be constrained from spectral fitting. The tabulated model and slim disk model are {\href{https://doi.org/10.25739/hfhz-xn60}{here.}


title: Electron microscopy probing electron-photon interactions in SiC nanowires with ultra-wide energy and momentum match

abstract: Nanoscale materials usually can trap light and strongly interact with it leading to many photonic device applications. The light-matter interactions are commonly probed by optical spectroscopy, which, however, have some limitations such as diffraction-limited spatial resolution, tiny momentum transfer and non-continuous excitation/detection. In this work, using scanning transmission electron microscopy-electron energy loss spectroscopy (STEM-EELS) with ultra-wide energy and momentum match and sub-nanometer spatial resolution, we study the optical microcavity resonant spectroscopy in a single SiC nanowire. The longitudinal Fabry-Perot (FP) resonating modes and the transverse whispering-gallery modes (WGMs) are simultaneously excited and detected, which span from near-infrared (~ 1.2 {\mu}m) to ultraviolet (~ 0.2 {\mu}m) spectral regime and the momentum transfer can be ranging up to 108 cm{^{-1}}. The size effects on the resonant spectra of nanowires are also revealed. Moreover, the nanoscale decay length of resonant EELS is revealed, which is contributed by the strongly localized electron-photon interactions in the SiC nanowire. This work provides a new alternative technique to investigate the optical resonating spectroscopy of a single nanowire structure and to explore the light-matter interactions in dielectric nanostructures, which is also promising for modulating free electrons via photonic structures.


title: The strong coupling $g_{X J/\psi\phi}$ of $X(4700) \to J/\psi \phi$ in the light-cone sum rules

abstract: We assign the scalar tetraquark and the D-wave tetraquark state for $X(4700)$ and calculate the width of the decay $X(4700)$ $\to J/\psi \phi$ within the framework of light-cone sum rules. The strong coupling $g_{X J/\psi \phi}$ is obtained by considering the technique of soft-meson approximation. We also investigate the mass and the decay constant of $X(4700)$ in the framework of SVZ sum rules. Our prediction for the mass is in agreement with the experimental measurement, and that for the decay width of $X(4700)$ $\to J/\psi \phi$ support the possibility that $X(4700)$ could be a scalar tetraquark state if $X(4700)$ $\to J/\psi \phi$ is the predominant decay channel, or a D-wave tetraquark state if $X(4700)$ $\to J/\psi \phi$ is not the predominant one and there exist other decays.


title: Biometric identification by means of hand geometry and a neural net classifier

abstract: This Paper describes a hand geometry biometric identification system. We have acquired a database of 22 people using a conventional document scanner. The experimental section consists of a study about the discrimination capability of different extracted features, and the identification rate using different classifiers based on neural networks.


title: Numerical study of the volcano e ect in chemotactic aggregation based on a kinetic transport equation with non-instantaneous tumbling

abstract: Aggregation of chemotactic bacteria under a unimodal distribution of chemical cues was investigated by Monte Carlo (MC) simulation based on a kinetic transport equation, which considers an internal adaptation dynamics as well as a finite tumbling duration. It was found that there exist two different regimes of the adaptation time, between which the effect of the adaptation time on the aggregation behavior is reversed; that is, when the adaptation time is as small as the running duration, the aggregation becomes increasingly steeper as the adaptation time increases, while, when the adaptation time is as large as the diffusion time of the population density, the aggregation becomes more diffusive as the adaptation time increases. Moreover, the aggregation profile becomes bimodal (volcano) at the large adaptation-time regime when the tumbling duration is sufficiently large while it is always unimodal at the small adaptation-time regime. A remarkable result of this study is the identification of the parameter regime and scaling for the volcano effect. That is, by comparing the results of MC simulations to the continuum-limit models obtained at each of the small and large adaptation-time scalings, it is clarified that the volcano effect arises due to the coupling of diffusion, adaptation, and finite tumbling duration, which occurs at the large adaptation-time scaling.


title: On computing the symplectic $LL^T$ factorization

abstract: We analyze two algorithms for computing the symplectic $LL^T$ factorization $A=LL^T$ of a given symmetric positive definite symplectic matrix $A$. The first algorithm $W_1$ is an implementation of the $HH^T$ factorization from [Dopico et al., 2009], see Theorem 5.2. The second one, algorithm $W_2$ uses both Cholesky and Reverse Cholesky decompositions of symmetric positive definite matrices. We presents a comparison of these algorithms and illustrate their properties by numerical experiments in MATLAB. A particular emphasis is given on simplecticity properties of the computed matrices in floating-point arithmetic.


title: Diverse Exotic Orders and Fermiology in Fe-based Superconductors: A Unified Mechanism for $B_{1g}/B_{2g}$ Nematicity in FeSe/(Cs,Rb)Fe$_2$As$_2$ and Smectic Order in BaFe$_2$As$_2$

abstract: A rich variety of nematic/smectic orders in Fe-based superconductors is an important unsolved problem in strongly correlated electron systems. A unified understanding of these orders has been investigated for the last decade. In this article, we explain the $B_{1g}$ symmetry nematic transition in FeSe$_{1-x}$Te$_x$, the $B_{2g}$ symmetry nematicity in AFe$_2$As$_2$ (A=Cs, Rb), and the smectic state in BaFe$_2$As$_2$ based on the same framework. We investigate the quantum interference mechanism between spin fluctuations by developing the density wave equation. The observed rich variety of nematic/smectic orders is naturally understood in this mechanism. The nematic/smectic orders depend on the characteristic shape and topology of the Fermi surface (FS) of each compound. (i) In FeSe$_{1-x}$Te$_x$, each FS is very small and the dxy-orbital hole pocket is below the Fermi level. In this case, the small spin fluctuations on three dxz, dyz, and dxy orbitals cooperatively lead to the $B_{1g}$ nematic order. The experimental Lifshitz transition below the nematic transition temperature $(T_S)$ is naturally reproduced. (ii) In BaFe$_2$As$_2$, the dxy-orbital hole pocket emerges around M point, and each FS is relatively large. The strong spin fluctuations due to the dxy-orbital nesting give rise to the $B_{1g}$ nematic order and the smectic order, and the latter transition temperature ($T^*$) exceeds the former one $T_S$. (iii) In heavily hole-doped AFe$_2$As$_2$, the large dxy-orbital hole pocket and the four tiny Dirac pockets appear due to the hole-doping. The $B_{2g}$ nematic bond order emerges on the dxy-orbital hole pocket due to the same interference mechanism. The present paramagnon interference mechanism provides a unified explanation of why the variety of nematic/smectic orders in Fe-based superconductors is so rich, based on the well-established fermiology of Fe-based superconductors.


title: Deep Hyperspectral-Depth Reconstruction Using Single Color-Dot Projection

abstract: Depth reconstruction and hyperspectral reflectance reconstruction are two active research topics in computer vision and image processing. Conventionally, these two topics have been studied separately using independent imaging setups and there is no existing method which can acquire depth and spectral reflectance simultaneously in one shot without using special hardware. In this paper, we propose a novel single-shot hyperspectral-depth reconstruction method using an off-the-shelf RGB camera and projector. Our method is based on a single color-dot projection, which simultaneously acts as structured light for depth reconstruction and spatially-varying color illuminations for hyperspectral reflectance reconstruction. To jointly reconstruct the depth and the hyperspectral reflectance from a single color-dot image, we propose a novel end-to-end network architecture that effectively incorporates a geometric color-dot pattern loss and a photometric hyperspectral reflectance loss. Through the experiments, we demonstrate that our hyperspectral-depth reconstruction method outperforms the combination of an existing state-of-the-art single-shot hyperspectral reflectance reconstruction method and depth reconstruction method.


title: From Rewriting to Remembering: Common Ground for Conversational QA Models

abstract: In conversational QA, models have to leverage information in previous turns to answer upcoming questions. Current approaches, such as Question Rewriting, struggle to extract relevant information as the conversation unwinds. We introduce the Common Ground (CG), an approach to accumulate conversational information as it emerges and select the relevant information at every turn. We show that CG offers a more efficient and human-like way to exploit conversational information compared to existing approaches, leading to improvements on Open Domain Conversational QA.


title: HINNPerf: Hierarchical Interaction Neural Network for Performance Prediction of Configurable Systems

abstract: Modern software systems are usually highly configurable, providing users with customized functionality through various configuration options. Understanding how system performance varies with different option combinations is important to determine optimal configurations that meet specific requirements. Due to the complex interactions among multiple options and the high cost of performance measurement under a huge configuration space, it is challenging to study how different configurations influence the system performance. To address these challenges, we propose HINNPerf, a novel hierarchical interaction neural network for performance prediction of configurable systems. HINNPerf employs the embedding method and hierarchic network blocks to model the complicated interplay between configuration options, which improves the prediction accuracy of the method. Besides, we devise a hierarchical regularization strategy to enhance the model robustness. Empirical results on 10 real-world configurable systems show that our method statistically significantly outperforms state-of-the-art approaches by achieving average 22.67% improvement in prediction accuracy. In addition, combined with the Integrated Gradients method, the designed hierarchical architecture provides some insights about the interaction complexity and the significance of configuration options, which might help users and developers better understand how the configurable system works and efficiently identify significant options affecting the performance.


title: A Complete Classification of Sub-Shocks in the Shock Structure of a Binary Mixture of Eulerian Gases with Different Degrees of Freedom

abstract: The shock structure in a binary mixture of polyatomic Eulerian gases with different degrees of freedom of a molecule is studied based on the multi-temperature model of rational extended thermodynamics. Since the system of field equations is hyperbolic, the shock-structure solution is not always regular, and discontinuous parts (sub-shocks) can be formed. For given values of the mass ratio and the specific heats of the constituents, we identify the possible sub-shocks as the Mach number $M_0$ of the shock wave and the concentration $c$ of the constituents change. In the plane $(c,M_0)$, we identify the possible regions for the sub-shock formation. The analysis is obtained to verify when the velocity of the shock wave meets a characteristic velocity in the unperturbed or perturbed equilibrium states that gives a necessary condition for the sub-shock formation. The condition becomes necessary and sufficient when the velocity of the shock becomes greater than the maximum characteristic velocity in the unperturbed state. Namely, the regions with no sub-shocks, a sub-shock for only one constituent, or sub-shocks for both constituents are comprehensively classified. The most interesting case is that the lighter molecule has more degrees of freedom than that of the heavy one. In this situation, the topology of the various regions becomes different. We also solve the system of the field equations numerically using the parameters in the various regions and confirm whether the sub-shocks emerge or not. Finally, the relationship between an acceleration wave in a constituent and the sub-shock in the other constituent is explicitly derived.


title: Estimation of Nitrogen-to-Iron Abundance Ratios From Low-Resolution Spectra

abstract: We present a method to determine nitrogen abundance ratios with respect to iron ([N/Fe]) from molecular CN-band features observed in low-resolution ($R \sim$ 2000) stellar spectra obtained by the Sloan Digital Sky Survey (SDSS) and the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST). Various tests are carried out to check the systematic and random errors of our technique, and the impact of signal-to-noise (S/N) ratios of stellar spectra on the determined [N/Fe]. We find that the uncertainty of our derived [N/Fe] is less than 0.3 dex for S/N ratios larger than 10 in the ranges $T_{eff}$ = [4000, 6000] K, log g = [0.0, 3.5], [Fe/H] = [--3.0, 0.0], [C/Fe] = [--1.0, +4.5], and [N/Fe] = [--1.0, +4.5], the parameter space that we are interested in to identify N-enhanced stars in the Galactic halo. A star-by-star comparison with a sample of stars with [N/Fe] estimates available from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) also suggests a similar level of uncertainty in our measured [N/Fe], after removing its systematic error. Based on these results, we conclude that our method is able to reproduce [N/Fe] from low-resolution spectroscopic data, with an uncertainty sufficiently small to discover N-rich stars that presumably originated from disrupted Galactic globular clusters.


title: Does Robustness on ImageNet Transfer to Downstream Tasks?

abstract: As clean ImageNet accuracy nears its ceiling, the research community is increasingly more concerned about robust accuracy under distributional shifts. While a variety of methods have been proposed to robustify neural networks, these techniques often target models trained on ImageNet classification. At the same time, it is a common practice to use ImageNet pretrained backbones for downstream tasks such as object detection, semantic segmentation, and image classification from different domains. This raises a question: Can these robust image classifiers transfer robustness to downstream tasks? For object detection and semantic segmentation, we find that a vanilla Swin Transformer, a variant of Vision Transformer tailored for dense prediction tasks, transfers robustness better than Convolutional Neural Networks that are trained to be robust to the corrupted version of ImageNet. For CIFAR10 classification, we find that models that are robustified for ImageNet do not retain robustness when fully fine-tuned. These findings suggest that current robustification techniques tend to emphasize ImageNet evaluations. Moreover, network architecture is a strong source of robustness when we consider transfer learning.


title: Study of a committee of neural networks for biometric hand-geometry recognition

abstract: This Paper studies different committees of neural networks for biometric pattern recognition. We use the neural nets as classifiers for identification and verification purposes. We show that a committee of nets can improve the recognition rates when compared with a multi-start initialization algo-rithm that just picks up the neural net which offers the best performance. On the other hand, we found that there is no strong correlation between identifi-cation and verification applications using the same classifier.


title: Holomorphic H\"ormander-Type Functional Calculus on Sectors and Strips

abstract: In this paper, recent abstract multiplier theorems for $0$-sectorial and $0$-strip type operators by Kriegler and Weis (2018) are refined and generalized to arbitrary sectorial and strip-type operators. To this end, holomorphic H\"ormander-type functions on sectors and strips are introduced with a scale of smoothness being finer than the classical polynomial one. Moreover, we establish alternative descriptions of these spaces involving Schwartz and "holomorphic Schwartz" functions. Finally, the abstract results are combined with a recent result by Carbonaro and Dragi\v{c}evi\'c (2017) to obtain an improvement -- with respect to the smoothness condition -- of the known H\"ormander-type multiplier theorem for general symmetric contraction semigroups.


title: Revealing Josephson vortex dynamics in proximity junctions below critical current

abstract: Made of a thin non-superconducting metal (N) sandwiched by two superconductors (S), SNS Josephson junctions enable novel quantum functionalities by mixing up the intrinsic electronic properties of N with the superconducting correlations induced from S by proximity. Electronic properties of these devices are governed by Andreev quasiparticles [1] which are absent in conventional SIS junctions whose insulating barrier (I) between the two S electrodes owns no electronic states. Here we focus on the Josephson vortex (JV) motion inside Nb-Cu-Nb proximity junctions subject to electric currents and magnetic fields. The results of local (Magnetic Force Microscopy) and global (transport) experiments provided simultaneously are compared with our numerical model, revealing the existence of several distinct dynamic regimes of the JV motion. One of them, identified as a fast hysteretic entry/escape below the critical value of Josephson current, is analyzed and suggested for low-dissipative logic and memory elements.


title: On Distinctive Image Captioning via Comparing and Reweighting

abstract: Recent image captioning models are achieving impressive results based on popular metrics, i.e., BLEU, CIDEr, and SPICE. However, focusing on the most popular metrics that only consider the overlap between the generated captions and human annotation could result in using common words and phrases, which lacks distinctiveness, i.e., many similar images have the same caption. In this paper, we aim to improve the distinctiveness of image captions via comparing and reweighting with a set of similar images. First, we propose a distinctiveness metric -- between-set CIDEr (CIDErBtw) to evaluate the distinctiveness of a caption with respect to those of similar images. Our metric reveals that the human annotations of each image in the MSCOCO dataset are not equivalent based on distinctiveness; however, previous works normally treat the human annotations equally during training, which could be a reason for generating less distinctive captions. In contrast, we reweight each ground-truth caption according to its distinctiveness during training. We further integrate a long-tailed weight strategy to highlight the rare words that contain more information, and captions from the similar image set are sampled as negative examples to encourage the generated sentence to be unique. Finally, extensive experiments are conducted, showing that our proposed approach significantly improves both distinctiveness (as measured by CIDErBtw and retrieval metrics) and accuracy (e.g., as measured by CIDEr) for a wide variety of image captioning baselines. These results are further confirmed through a user study.


title: GigaST: A 10,000-hour Pseudo Speech Translation Corpus

abstract: This paper introduces GigaST, a large-scale pseudo speech translation (ST) corpus. We create the corpus by translating the text in GigaSpeech, an English ASR corpus, into German and Chinese. The training set is translated by a strong machine translation system and the test set is translated by human. ST models trained with an addition of our corpus obtain new state-of-the-art results on the MuST-C English-German benchmark test set. We provide a detailed description of the translation process and verify its quality. We make the translated text data public and hope to facilitate research in speech translation. Additionally, we also release the training scripts on NeurST to make it easy to replicate our systems. GigaST dataset is available at https://st-benchmark.github.io/resources/GigaST.


title: IgA-BEM for 3D Helmholtz problems on multi-patch domains using B-spline tailored numerical integration

abstract: An Isogeometric Boundary Element Method (IgA-BEM) is considered for the numerical solution of Helmholtz problems on 3D bounded or unbounded domains, admitting a smooth conformal multi-patch representation of their finite boundary surface. The discretization space is formed by $C^0$ inter-patch continuous basis functions whose restriction to a patch simplifies to the span of tensor product B-splines composed with the given patch parameterization. For both regular and singular integration, the proposed model utilizes a numerical procedure defined on the support of each trial B-spline function, which makes possible a function--by--function implementation of the matrix assembly phase. Spline quasi-interpolation is the common ingredient of all the considered quadrature rules; in the singular case it is combined with a B-spline recursion over the spline degree and with a singularity extraction technique, extended to the multi-patch setting for the first time. A threshold selection strategy is proposed to automatically distinguish between nearly singular and regular integrals. Numerical examples on relevant benchmarks show that the expected convergence orders are achieved with uniform discretization and a small number of uniformly spaced quadrature nodes.


title: A novel concept for a fully digital particle detector

abstract: Silicon sensors are the most diffuse position sensitive device in particle physics 8 experiments and in countless applications in science and technology. They had a spectacular progress in performance over almost 40 years since their first introduction, but their evolution is now slowing down. The position resolution for single particle hits is larger than a few microns in the most advanced sensors. This value was reached already over 30 years ago [1]. The minimum ionising path length a sensor can detect is several tens of microns. There are fundamental reasons why these limits will not be substantially improved by further refinements of the current technology. This makes silicon sensors unsuitable to applications where the physics signature is the short path of a recoiling atom and constrains the layout of physics experiments where they represent by far the best option like high energy physics collider experiments. In perspective, the availability of sensors with sub-micron spatial resolution, in the order of a few tens of nanometres, would be a disruptive change for the sensor technology with a foreseeable huge impact on experiment layout and various applications of these devices. For providing such a leap in resolution, we propose a novel design based on a purely digital circuit. This disruptive concept potentially enables pixel sizes much smaller than 1{\mu}m2 and a number of advantages in terms of power consumption, readout speed and reduced thickness (for low mass sensors).


title: WG3 Summary -- Rare $B$, $D$ and $K$ decays

abstract: We summarize the presentations made within Working Group 3 of the CKM2021 workshop. This working group is devoted to rare $B$, $D$ and $K$ decays, radiative and electroweak-penguin decays, including constraints on $V_{\rm td}/V_{\rm ts}$ and $\epsilon^\prime / \epsilon$. The working group has thus a very broad scope, and includes very topical subjects such as the coherent array of discrepancies in semi-leptonic $B$ decays. Each contribution is here summarized very succinctly with the aim of providing an overview of the main results. The reader interested in fuller details is referred to the individual contributions.


title: Tensor approximation of the self-diffusion matrix of tagged particle processes

abstract: The objective of this paper is to investigate a new numerical method for the approximation of the self-diffusion matrix of a tagged particle process defined on a grid. While standard numerical methods make use of long-time averages of empirical means of deviations of some stochastic processes, and are thus subject to statistical noise, we propose here a tensor method in order to compute an approximation of the solution of a high-dimensional quadratic optimization problem, which enables to obtain a numerical approximation of the self-diffusion matrix. The tensor method we use here relies on an iterative scheme which builds low-rank approximations of the quantity of interest and on a carefully tuned variance reduction method so as to evaluate the various terms arising in the functional to minimize. In particular, we numerically observe here that it is much less subject to statistical noise than classical approaches.


title: Channel model for end-to-end learning of communications systems: A survey

abstract: The traditional communication model based on chain of multiple independent processing blocks is constraint to efficiency and introduces artificial barriers. Thus, each individually optimized block does not guarantee end-to-end performance of the system. Recently, end-to-end learning of communications systems through machine learning (ML) have been proposed to optimize the system metrics jointly over all components. These methods show performance improvements but has a limitation that it requires a differentiable channel model. In this study, we have summarized the existing approaches that alleviates this problem. We believe that this study will provide better understanding of the topic and an insight into future research in this field.