title: Deep learning classification of large-scale point clouds: A case study on cuneiform tablets

abstract: This paper introduces a novel network architecture for the classification of large-scale point clouds. The network is used to classify metadata from cuneiform tablets. As more than half a million tablets remain unprocessed, this can help create an overview of the tablets. The network is tested on a comparison dataset and obtains state-of-the-art performance. We also introduce new metadata classification tasks on which the network shows promising results. Finally, we introduce the novel Maximum Attention visualization, demonstrating that the trained network focuses on the intended features. Code available at https://github.com/fhagelskjaer/dlc-cuneiform


title: A pathwise parameterisation for stochastic transport

abstract: In this work we set the stage for a new probabilistic pathwise approach to effectively calibrate a general class of stochastic nonlinear fluid dynamics models. We focus on a 2D Euler SALT equation, showing that the driving stochastic parameter can be calibrated in an optimal way to match a set of given data. Moreover, we show that this model is robust with respect to the stochastic parameters.


title: 2-adic point counting on $K3$ surfaces

abstract: This article reports on an approach to point counting on algebraic varieties over finite fields that is based on a detailed investigation of the $2$-adic orthogonal group. Combining the new approach with a $p$-adic method, we count the number of points on some $K3$ surfaces over the field $\bbF_{\!p}$, for all primes $p < 10^8$.


title: Ab initio quantum theory of mass defect and time dilation in trapped-ion optical clocks

abstract: We derive a Hamiltonian for the external and internal dynamics of an electromagnetically bound, charged two-particle system in external electromagnetic and gravitational fields, including leading-order relativistic corrections. We apply this Hamiltonian to describe the relativistic coupling of the external and internal dynamics of cold ions in Paul traps, including the effects of micromotion, excess micromotion, and trap imperfections. This provides a systematic and fully quantum-mechanical treatment of relativistic frequency shifts in atomic clocks based on single trapped ions. Our approach reproduces well-known formulas for the second-order Doppler shift for thermal states, which were previously derived on the basis of semiclassical arguments. We complement and clarify recent discussions in the literature on the role of time dilation and mass defect in ion clocks.


title: NU HLT at CMCL 2022 Shared Task: Multilingual and Crosslingual Prediction of Human Reading Behavior in Universal Language Space

abstract: In this paper, we present a unified model that works for both multilingual and crosslingual prediction of reading times of words in various languages. The secret behind the success of this model is in the preprocessing step where all words are transformed to their universal language representation via the International Phonetic Alphabet (IPA). To the best of our knowledge, this is the first study to favorable exploit this phonological property of language for the two tasks. Various feature types were extracted covering basic frequencies, n-grams, information theoretic, and psycholinguistically-motivated predictors for model training. A finetuned Random Forest model obtained best performance for both tasks with 3.8031 and 3.9065 MAE scores for mean first fixation duration (FFDAvg) and mean total reading time (TRTAvg) respectively.


title: On some equivalent norms in Sobolev spaces on bounded domains and on the boundaries

abstract: We consider the equivalence of some norms in Sobolev spaces on bounded domains of the d-dimensional real Euclidean space and also in Sobolev spaces on the boundaries of those domains.


title: Brownian motion with time-dependent friction and single-particle dynamics in liquids

abstract: A microscopic theory of molecular motion in classical monatomic liquids, proposed by Glass and Rice [Phy. Rev. 176, 239 (1968)], is revisited and extended to incorporate the dynamic friction in the Brownian description of the atomic diffusion in a mean-time-dependent harmonic force field. A modified, non-Markovian Langevin equation is utilized to derive an equation of motion for the velocity autocorrelation function with time-dependent friction coefficient. Numerical solution of the equation gives an excellent account of the velocity autocorrelation function in LJ liquids, liquid alkali and transition metals over a broad range of density and temperature. Derivation of the equation of motion leads to a self-consistent expression for the time-dependence of friction coefficient. Our results demonstrate that the nature of time-dependence of the friction coefficient changes dramatically with the liquid density. At low and moderate densities, the dynamic friction decays exponentially whereas it increases exponentially at high liquid densities. Our findings provide an opportunity to have a new outlook of the Brownian description of atomic dynamics in liquids.


title: Improvement of the parameter measurement accuracy by the third-generation gravitational wave detector Einstein Telescope

abstract: The Einstein Telescope (ET) has been proposed as one of the third-generation gravitational wave (GW) detectors. The sensitivity of ET would be a factor of 10 better than the second-generation GW detector, Advanced LIGO (aLIGO); thus, the GW source parameters could be measured with much better accuracy. In this work, we show how the precision in parameter estimation can be improved between aLIGO and ET by comparing the measurement errors. We apply the TaylorF2 waveform model defined in the frequency domain to the Fisher matrix method which is a semi-analytic approach for estimating GW parameter measurement errors. We adopt as our sources low-mass binary black holes with the total masses of $M\leq 16 M_{\odot} $ and the effective spins of $-0.9 \leq \chi_{\rm eff} \leq 0.9$ and calculate the measurement errors of the mass and the spin parameters using $10^4$ Monte-Carlo samples randomly distributed in our mass and spin parameter space. We find that for the same sources ET can achieve $\sim 14$ times better signal-to-noise ratio than aLIGO and the error ratios ($\sigma_{\lambda, \rm ET}/\sigma_{\lambda, \rm aLIGO}$) for the chirp-mass, symmetric mass ratio, and effective spin parameters can be lower than $7\%$ for all binaries. We also consider the equal-mass binary neutron stars with the component masses of 1, 1.4, and 2 $M_{\odot}$ and find that the error ratios for the mass and the spin parameters can be lower than $1.5 \%$. In particular, the measurement error of the tidal deformability $\tilde{\Lambda}$ can also be significantly reduced by ET, with the error ratio of $3.6 - 6.1 \%$.


title: Unconventional pressure dependence of the superfluid density in the nodeless topological superconductor $\alpha$-PdBi$_2$

abstract: We investigated the superconducting properties of the topological superconductor $\alpha$--PdBi$_2$ at ambient and external pressures up to 1.77~GPa using muon spin rotation ($\mu$SR) experiments. The ambient pressure measurements evince a fully gapped $s$-wave superconducting state in the bulk of the specimen. AC magnetic susceptibility and $\mu$SR measurements manifest a continuous suppression of $T_{\rm c}$ with increasing pressure. In parallel, we observed a significant decrease of superfluid density by $\sim$20\% upon application of external pressure. Remarkably, the superfluid density follows linear relation with $T_{\rm c}$ which was found before in some unconventional topological superconductors and hole doped cuprates. This finding signals a possible crossover from BEC to BCS in $\alpha$--PdBi$_2$.


title: Gate-Tunable Transmon Using Selective-Area-Grown Superconductor-Semiconductor Hybrid Structures on Silicon

abstract: We present a gate-voltage tunable transmon qubit (gatemon) based on planar InAs nanowires that are selectively grown on a high resistivity silicon substrate using III-V buffer layers. We show that low loss superconducting resonators with an internal quality of $2\times 10^5$ can readily be realized using these substrates after the removal of buffer layers. We demonstrate coherent control and readout of a gatemon device with a relaxation time, $T_{1}\approx 700\,\mathrm{ns}$, and dephasing times, $T_2^{\ast}\approx 20\,\mathrm{ns}$ and $T_{\mathrm{2,echo}} \approx 1.3\,\mathrm{\mu s}$. Further, we infer a high junction transparency of $0.4 - 0.9$ from an analysis of the qubit anharmonicity.


title: Efficient computation of states and sensitivities for compound structural optimisation problems using a Linear Dependency Aware Solver (LDAS)

abstract: Real-world structural optimisation problems involve multiple loading conditions and design constraints, with responses typically depending on states of discretised governing equations. Generally, one uses gradient-based nested analysis and design approaches to solve these problems. Herein, solving both physical and adjoint problems dominates the overall computational effort. Although not commonly detected, real-world problems can contain linear dependencies between encountered physical and adjoint loads. Manually keeping track of such dependencies becomes tedious as design problems become increasingly involved. To detect and exploit such dependencies, this work proposes the use of a Linear Dependency Aware Solver (LDAS), which is able to efficiently detect linear dependencies between all loads to avoid unnecessary solves entirely and automatically. Illustrative examples are provided that demonstrate the need and benefits of using an LDAS, including a run-time experiment.


title: Asynchronous Fully-Decentralized SGD in the Cluster-Based Model

abstract: This paper presents fault-tolerant asynchronous Stochastic Gradient Descent (SGD) algorithms. SGD is widely used for approximating the minimum of a cost function $Q$, as a core part of optimization and learning algorithms. Our algorithms are designed for the cluster-based model, which combines message-passing and shared-memory communication layers. Processes may fail by crashing, and the algorithm inside each cluster is wait-free, using only reads and writes. For a strongly convex function $Q$, our algorithm tolerates any number of failures, and provides convergence rate that yields the maximal distributed acceleration over the optimal convergence rate of sequential SGD. For arbitrary functions, the convergence rate has an additional term that depends on the maximal difference between the parameters at the same iteration. (This holds under standard assumptions on $Q$.) In this case, the algorithm obtains the same convergence rate as sequential SGD, up to a logarithmic factor. This is achieved by using, at each iteration, a multidimensional approximate agreement algorithm, tailored for the cluster-based model. The algorithm for arbitrary functions requires that at least a majority of the clusters contain at least one nonfaulty process. We prove that this condition is necessary when optimizing some non-convex functions.


title: Properties of accretion flow in deformed Kerr spacetime

abstract: We study the properties of a low-angular momentum, inviscid, advective accretion flow in a deformed Kerr spacetime under the framework of general theory of relativity. We solve the governing equations that describe the flow motion in terms of input parameters, namely energy ($E$), angular momentum ($\lambda$), spin ($a_{\rm k}$) and deformation parameter ($\varepsilon$), respectively. We find that global transonic accretion solutions continue to exist in non-Kerr spacetime. Depending on the input parameters, accretion flow is seen to experience shock transition and we find that shocked induced accretion solutions are available for a wide range of the parameter space in $\lambda-E$ plane. We examine the modification of the shock parameter space with $\varepsilon$, and find that as $\varepsilon$ is increased, the effective region of the parameter space is reduced, and gradually shifted towards the higher $\lambda$ and lower $E$ domain. In addition, for the first time in the literature, we notice that accretion flow having zero angular momentum admits shock transition when spacetime deformation is significantly large. Interestingly, beyond a critical limit of $\varepsilon^{\rm max}$, the nature of the central object alters from black hole (BH) to naked singularity (NS) and we identify $\varepsilon^{\rm max}$ as function of $a_{\rm k}$. Further, we examine the accretion solutions and its properties around the naked singularity as well. Finally, we indicate the implications of the present formalism in the context of astrophysical applications.


title: Some questions about Conformal Cyclic Cosmology

abstract: This article is an extended version of a talk given in Oxford in June 2021 as part of an online meeting `Ninety minutes of CCC' to mark the 90th birthday of Sir Roger Penrose. I assemble some questions that I have been asked or have asked myself about CCC.


title: Ideal growth in amalgamated powers of nilpotent rings of class two and zeta functions of quiver representations

abstract: Let $L$ be a nilpotent algebra of class two over a compact discrete valuation ring $A$ of characteristic zero or of sufficiently large positive characteristic. Let $q$ be the residue cardinality of $A$. The ideal zeta function of $L$ is a Dirichlet series enumerating finite-index ideals of $L$. We prove that there is a rational function in $q$, $q^m$, $q^{-s}$, and $q^{-ms}$ giving the ideal zeta function of the amalgamation of $m$ copies of $L$ over the derived subring, for every $m \geq 1$, up to an explicit factor. More generally, we prove this for the zeta functions of nilpotent quiver representations of class two defined by Lee and Voll, and in particular for Dirichlet series counting graded submodules of a graded $A$-module. If the algebra $L$, or the quiver representation, is defined over $\mathbb{Z}$, then we obtain a uniform rationality result.


title: Stateful Structural Operational Semantics

abstract: Compositionality of denotational semantics is an important concern in programming semantics. Mathematical operational semantics in the sense of Turi and Plotkin guarantees compositionality, but seen from the point of view of stateful computation it applies only to very fine-grained equivalences that essentially assume unrestricted interference by the environment between any two statements. We introduce the more restrictive stateful SOS rule format for stateful languages. We show that compositionality of two more coarse-grained semantics, respectively given by assuming read-only interference or no interference between steps, remains an undecidable property even for stateful SOS. However, further restricting the rule format in a manner inspired by the cool GSOS formats of Bloom and van Glabbeek, we obtain the streamlined and cool stateful SOS formats, which respectively guarantee compositionality of the two more abstract equivalences.


title: Subelliptic estimates for the $\bar{\partial}$-problem on complex algebraic surfaces with isolated singularities

abstract: We obtain subelliptic estimates for the $\bar{\partial}$-problem on complex algebraic surfaces embedded in $\mathbb{C}^n$ with isolated singularities. $W^{\epsilon}$ Sobolev norms of a form, $f$, for $0< \epsilon < 1$ are estimated in terms of weighted $L^2$ norms of $\bar{\partial} f$ and $\bar{\partial}^{\ast}f$, with weights which vanish at the singularities, as well as weighted $L^2$ norms of $f$, with weights which blow up at the singularities.


title: Neural Program Repair: Systems, Challenges and Solutions

abstract: Automated Program Repair (APR) aims to automatically fix bugs in the source code. Recently, as advances in Deep Learning (DL) field, there is a rise of Neural Program Repair (NPR) studies, which formulate APR as a translation task from buggy code to correct code and adopt neural networks based on encoder-decoder architecture. Compared with other APR techniques, NPR approaches have a great advantage in applicability because they do not need any specification (i.e., a test suite). Although NPR has been a hot research direction, there isn't any overview on this field yet. In order to help interested readers understand architectures, challenges and corresponding solutions of existing NPR systems, we conduct a literature review on latest studies in this paper. We begin with introducing the background knowledge on this field. Next, to be understandable, we decompose the NPR procedure into a series of modules and explicate various design choices on each module. Furthermore, we identify several challenges and discuss the effect of existing solutions. Finally, we conclude and provide some promising directions for future research.


title: Performance Enhancement of C-V2X Mode 4 Utilizing Multiple Candidate Single-subframe Resources

abstract: Prioritization of data streams in cellular vehicle-to-everything (C-V2X) may lead to unfavorable packet delays in low priority streams. This paper studies the allocation of multiple candidate single-subframe resources (CSRs) per vehicle as a solution. It proposes a methodology to determine the number of CSRs for each vehicle based on the number of total vehicles, and to assign the multiple data streams among them for simultaneous transmission. The numerical results highlight the achievable delay gains of the proposed approach, and its negligible impact on packet collisions.


title: Socialformer: Social Network Inspired Long Document Modeling for Document Ranking

abstract: Utilizing pre-trained language models has achieved great success for neural document ranking. Limited by the computational and memory requirements, long document modeling becomes a critical issue. Recent works propose to modify the full attention matrix in Transformer by designing sparse attention patterns. However, most of them only focus on local connections of terms within a fixed-size window. How to build suitable remote connections between terms to better model document representation remains underexplored. In this paper, we propose the model Socialformer, which introduces the characteristics of social networks into designing sparse attention patterns for long document modeling in document ranking. Specifically, we consider several attention patterns to construct a graph like social networks. Endowed with the characteristic of social networks, most pairs of nodes in such a graph can reach with a short path while ensuring the sparsity. To facilitate efficient calculation, we segment the graph into multiple subgraphs to simulate friend circles in social scenarios. Experimental results confirm the effectiveness of our model on long document modeling.


title: Dynamical system analysis of Myrzakulov gravity

abstract: We perform a dynamical system analysis of Myrzakulov or F(R, T) gravity, which is a subclass of affinely connected metric theories, where ones uses a specific but non-special connection, which allows for non-zero curvature and torsion simultaneously. We consider two classes of models, we extract the critical points, and we examine their stability properties alongside their physical features. In the Class 1 models, which possess {\Lambda}CDM cosmology as a limit, we find the sequence of matter and dark energy eras, and we show that the Universe will result in a dark-energy dominated critical point for which dark energy behaves like a cosmological constant. Concerning the dark-energy equation-of-state parameter we find that it lies in the quintessence or phantom regime, according to the value of the model parameter. For the Class 2 models, we again find the dark-energy dominated, de Sitter late-time attractor, although the scenario does not possess {\Lambda}CDM cosmology as a limit. The cosmological behavior is richer, and the dark-energy sector can be quintessence-like, phantom-like, or experience the phantom-divide crossing during the evolution.


title: Choquet-Based Fuzzy Rough Sets

abstract: Fuzzy rough set theory can be used as a tool for dealing with inconsistent data when there is a gradual notion of indiscernibility between objects. It does this by providing lower and upper approximations of concepts. In classical fuzzy rough sets, the lower and upper approximations are determined using the minimum and maximum operators, respectively. This is undesirable for machine learning applications, since it makes these approximations sensitive to outlying samples. To mitigate this problem, ordered weighted average (OWA) based fuzzy rough sets were introduced. In this paper, we show how the OWA-based approach can be interpreted intuitively in terms of vague quantification, and then generalize it to Choquet-based fuzzy rough sets (CFRS). This generalization maintains desirable theoretical properties, such as duality and monotonicity. Furthermore, it provides more flexibility for machine learning applications. In particular, we show that it enables the seamless integration of outlier detection algorithms, to enhance the robustness of machine learning algorithms based on fuzzy rough sets.


title: Ligandformer: A Graph Neural Network for Predicting Compound Property with Robust Interpretation

abstract: Robust and efficient interpretation of QSAR methods is quite useful to validate AI prediction rationales with subjective opinion (chemist or biologist expertise), understand sophisticated chemical or biological process mechanisms, and provide heuristic ideas for structure optimization in pharmaceutical industry. For this purpose, we construct a multi-layer self-attention based Graph Neural Network framework, namely Ligandformer, for predicting compound property with interpretation. Ligandformer integrates attention maps on compound structure from different network blocks. The integrated attention map reflects the machine's local interest on compound structure, and indicates the relationship between predicted compound property and its structure. This work mainly contributes to three aspects: 1. Ligandformer directly opens the black-box of deep learning methods, providing local prediction rationales on chemical structures. 2. Ligandformer gives robust prediction in different experimental rounds, overcoming the ubiquitous prediction instability of deep learning methods. 3. Ligandformer can be generalized to predict different chemical or biological properties with high performance. Furthermore, Ligandformer can simultaneously output specific property score and visible attention map on structure, which can support researchers to investigate chemical or biological property and optimize structure efficiently. Our framework outperforms over counterparts in terms of accuracy, robustness and generalization, and can be applied in complex system study.


title: Groebner fan and embedded resolutions of ideals on toric varieties

abstract: We consider the notions of Groebner fan and Newton non-degeneracy for an ideal on a toric variety, extending the two existing notions for ideals on affine spaces. We prove, without assumptions on the characteristic of the base fields, that the "Groebner fan" of such an ideal is actually a polyhedral fan and that a sub-variety defined by a Newton non-degenerate ideal on a toric variety $X_\sigma$ admits a toric embedded resolution of singularities $Z\longrightarrow X_\sigma.$


title: Data-Consistent Local Superresolution for Medical Imaging

abstract: In this work we propose a new paradigm of iterative model-based reconstruction algorithms for providing real-time solution for zooming-in and refining a region of interest in medical and clinical tomographic (such as CT/MRI/PET, etc) images. This algorithmic framework is tailor for a clinical need in medical imaging practice, that after a reconstruction of the full tomographic image, the clinician may believe that some critical parts of the image are not clear enough, and may wish to see clearer these regions-of-interest. A naive approach (which is highly not recommended) would be performing the global reconstruction of a higher resolution image, which has two major limitations: firstly, it is computationally inefficient, and secondly, the image regularization is still applied globally which may over-smooth some local regions. Furthermore if one wish to fine-tune the regularization parameter for local parts, it would be computationally infeasible in practice for the case of using global reconstruction. Our new iterative approaches for such tasks are based on jointly utilizing the measurement information, efficient upsampling/downsampling across image spaces, and locally adjusted image prior for efficient and high-quality post-processing. The numerical results in low-dose X-ray CT image local zoom-in demonstrate the effectiveness of our approach.


title: Observation of rovibrationally coupled bi-modality and speed-dependent orientation in DEA dynamics of OCS: reveals partial correlations among point group symmetries

abstract: Dissociative electron attachment (DEA) to gas-phase carbonyl sulfide (OCS) has been studied diligently using the time-of-flight (TOF) based state-of-the-art velocity map imaging (VMI) technique. Three well-resolved DEA resonances are observed at 5.0, 6.5 and 10.0 eV incident electron energies along with a weak structure at 8.0 eV. The velocity slice images (VSI), Kinetic energy (KE) and angular distributions (AD) for the fragmented sulfur anions are obtained using the wedge slicing technique. The KE distributions for the sulfur nascent fragments reveal bi-modality with rovibrational signatures. The ADs substantiate speed-dependent angular anisotropy demand the existence of partial correlations among three different point group symmetries, confirmed through an in-plane bending mode of vibration with the axial recoil breakdown. Theoretical calculations using R-matrix and density functional approaches strongly support the experimental observations.


title: Gamma-Ray Polarimetry of the Crab Pulsar Observed by POLAR

abstract: The X/$\gamma$ ray polarimetry of the Crab pulsar/nebula is believed to hold crucial information on their emission models. In the past, several missions have shown evidence of polarized emission from the Crab. The significance of these measurements remains however limited. New measurements are therefore required. POLAR is a wide Field of View Compton-scattering polarimeter (sensitive in 50-500 keV) onboard the Chinese spacelab Tiangong-2 which took data from September 2016 to April 2017. Although not designed to perform polarization measurements of pulsars, we present here a novel method which can be applied to POLAR as well as that of other wide Field of View polarimeters. The novel polarimetric joint-fitting method for the Crab pulsar observations with POLAR, allows us to obtain constraining measurements of the pulsar component. The best fitted values and corresponding 1$\sigma$ deviations for the averaged phase interval: (PD=$14\substack{+15 \\ -10}$\%, PA=$108\substack{+33 \\ -54} ^{\circ}$), for Peak 1: (PD=$17\substack{+18 \\ -12}$\%, PA=$174\substack{+39 \\ -36} ^{\circ}$) and for Peak 2: (PD=$16\substack{+16 \\ -11}$\%, PA=$78\substack{+39 \\ -30} ^{\circ}$). Further more, the 3$\sigma$ upper limits on the polarization degree are for the averaged phase interval (55\%), Peak 1 (66\%) and Peak 2 (57\%). Finally, to illustrate the capabilities of this method in the future, we simulated two years observation to the Crab pulsar with POLAR-2. The results show that POLAR-2 is able to confirm the emission to be polarized with $5\sigma$ and $4\sigma$ confidence level if the Crab pulsar is polarized at $20\%$ and $10\%$ respectively.


title: A fundamental condition for harmonic analysis in anisotropic generalized Orlicz spaces

abstract: Anisotropic generalized Orlicz spaces have been investigated in many recent papers, but the basic assumptions are not as well understood as in the isotropic case. We study the greatest convex minorant of anisotropic $\Phi$-functions and prove the equivalence of two widely used conditions in the theory of generalized Orlicz spaces, usually called (A1) and (M). This provides a more natural and easily verifiable condition for use in the theory of anisotropic generalized Orlicz spaces for results such as Jensen's inequality which we obtain as a corollary.


title: Evaluating Persian Tokenizers

abstract: Tokenization plays a significant role in the process of lexical analysis. Tokens become the input for other natural language processing tasks, like semantic parsing and language modeling. Natural Language Processing in Persian is challenging due to Persian's exceptional cases, such as half-spaces. Thus, it is crucial to have a precise tokenizer for Persian. This article provides a novel work by introducing the most widely used tokenizers for Persian and comparing and evaluating their performance on Persian texts using a simple algorithm with a pre-tagged Persian dependency dataset. After evaluating tokenizers with the F1-Score, the hybrid version of the Farsi Verb and Hazm with bounded morphemes fixing showed the best performance with an F1 score of 98.97%.


title: Robust static and dynamic maximum flows

abstract: We study the robust maximum flow problem and the robust maximum flow over time problem where a given number of arcs $\Gamma$ may fail or may be delayed. Two prominent models have been introduced for these problems: either one assigns flow to arcs fulfilling weak flow conservation in any scenario, or one assigns flow to paths where an arc failure or delay affects a whole path. We provide a unifying framework by presenting novel general models, in which we assign flow to subpaths. These models contain the known models as special cases and unify their advantages in order to obtain less conservative robust solutions. We give a thorough analysis with respect to complexity of the general models. In particular, we show that the general models are essentially NP-hard, whereas, e.g. in the static case with $\Gamma = 1$ an optimal solution can be computed in polynomial time. Further, we answer the open question about the complexity of the dynamic path model for $\Gamma = 1$. We also compare the solution quality of the different models. In detail, we show that the general models have better robust optimal values than the known models and we prove bounds on these gaps.


title: Coordinate-Aligned Multi-Camera Collaboration for Active Multi-Object Tracking

abstract: Active Multi-Object Tracking (AMOT) is a task where cameras are controlled by a centralized system to adjust their poses automatically and collaboratively so as to maximize the coverage of targets in their shared visual field. In AMOT, each camera only receives partial information from its observation, which may mislead cameras to take locally optimal action. Besides, the global goal, i.e., maximum coverage of objects, is hard to be directly optimized. To address the above issues, we propose a coordinate-aligned multi-camera collaboration system for AMOT. In our approach, we regard each camera as an agent and address AMOT with a multi-agent reinforcement learning solution. To represent the observation of each agent, we first identify the targets in the camera view with an image detector, and then align the coordinates of the targets in 3D environment. We define the reward of each agent based on both global coverage as well as four individual reward terms. The action policy of the agents is derived with a value-based Q-network. To the best of our knowledge, we are the first to study the AMOT task. To train and evaluate the efficacy of our system, we build a virtual yet credible 3D environment, named "Soccer Court", to mimic the real-world AMOT scenario. The experimental results show that our system achieves a coverage of 71.88%, outperforming the baseline method by 8.9%.


title: Multiplicity of the doubly charmed state $T_{cc} ^+$ in heavy-ion collisions

abstract: We study the evolution of the doubly charmed state $T_{cc}^+$ in a hot hadron gas produced in the late stage of heavy-ion collisions. We use effective Lagrangians to calculate the thermally averaged cross sections of $T_{cc}^+$ production in reactions such as $ D^{(*)} D^{(*)} \rightarrow T_{cc}^+ \pi, T_{cc}^+ \rho $ and its absorption in the corresponding inverse processes. We then solve the rate equation to follow the time evolution of the $T_{cc}^+$ multiplicity, and determine how it is affected by the considered reactions during the expansion of the hadronic matter. We compare the evolution of the $T_{cc}^+$ abundance treated as a hadronic $S$-wave molecule and as a tetraquark state. Our results show that the tetraquark yield increases by a factor of about 2 at freeze-out, but it is still one order of magnitude smaller than the final yield of molecules formed from hadron coalescence. Also, the results indicate that $N_{T_{cc}}$ is more affected by interactions with hadronic medium than $ N_{X(3872)} $ in similar conditions. We also show that yields depend very weakly on the system size, represented by $\mathcal{N} = \left[ d N_{ch} / d \eta (\eta < 0.5)\right]^{1/3}$.


title: Information Design in Smooth Games

abstract: We study information design in games in which each player has a continuum of actions. We show that an information structure is designer-optimal whenever the equilibrium play it induces can also be implemented in a principal-agent contracting problem. We use this observation to solve three novel applications. In an investment game, the optimal structure fully informs a single investor while providing no information to others. In an expectation polarization game, the optimal structure fully informs half of the players while providing no information to the other half. In a price competition game, the optimal structure is noise-free Gaussian and recommends prices linearly in the states. Our analysis further informs on the robustness and uniqueness of the optimal information structures.


title: Utilizing Out-Domain Datasets to Enhance Multi-Task Citation Analysis

abstract: Citations are generally analyzed using only quantitative measures while excluding qualitative aspects such as sentiment and intent. However, qualitative aspects provide deeper insights into the impact of a scientific research artifact and make it possible to focus on relevant literature free from bias associated with quantitative aspects. Therefore, it is possible to rank and categorize papers based on their sentiment and intent. For this purpose, larger citation sentiment datasets are required. However, from a time and cost perspective, curating a large citation sentiment dataset is a challenging task. Particularly, citation sentiment analysis suffers from both data scarcity and tremendous costs for dataset annotation. To overcome the bottleneck of data scarcity in the citation analysis domain we explore the impact of out-domain data during training to enhance the model performance. Our results emphasize the use of different scheduling methods based on the use case. We empirically found that a model trained using sequential data scheduling is more suitable for domain-specific usecases. Conversely, shuffled data feeding achieves better performance on a cross-domain task. Based on our findings, we propose an end-to-end trainable multi-task model that covers the sentiment and intent analysis that utilizes out-domain datasets to overcome the data scarcity.


title: Learning Infomax and Domain-Independent Representations for Causal Effect Inference with Real-World Data

abstract: The foremost challenge to causal inference with real-world data is to handle the imbalance in the covariates with respect to different treatment options, caused by treatment selection bias. To address this issue, recent literature has explored domain-invariant representation learning based on different domain divergence metrics (e.g., Wasserstein distance, maximum mean discrepancy, position-dependent metric, and domain overlap). In this paper, we reveal the weaknesses of these strategies, i.e., they lead to the loss of predictive information when enforcing the domain invariance; and the treatment effect estimation performance is unstable, which heavily relies on the characteristics of the domain distributions and the choice of domain divergence metrics. Motivated by information theory, we propose to learn the Infomax and Domain-Independent Representations to solve the above puzzles. Our method utilizes the mutual information between the global feature representations and individual feature representations, and the mutual information between feature representations and treatment assignment predictions, in order to maximally capture the common predictive information for both treatment and control groups. Moreover, our method filters out the influence of instrumental and irrelevant variables, and thus it effectively increases the predictive ability of potential outcomes. Experimental results on both the synthetic and real-world datasets show that our method achieves state-of-the-art performance on causal effect inference. Moreover, our method exhibits reliable prediction performances when facing data with different characteristics of data distributions, complicated variable types, and severe covariate imbalance.


title: Limitations of nearest-neighbour quantum networks

abstract: Quantum communication research has in recent years shifted to include multi-partite networks for which questions of quantum network routing naturally emerge. To understand the potential for multi-partite routing, we focus on the most promising architectures for future quantum networks - those connecting nodes close to each other. Nearest-neighbour networks such as rings, lines, and grids, have been studied under different communication scenarios to facilitate the sharing of quantum resources, especially in the presence of bottlenecks. We here analyze the potential of nearest-neighbour quantum networks and identify some serious limitations, by demonstrating that rings and lines cannot overcome common bottleneck communication problems.


title: Policy Evaluation for Temporal and/or Spatial Dependent Experiments

abstract: The aim of this paper is to establish a causal link between the policies implemented by technology companies and the outcomes they yield within intricate temporal and/or spatial dependent experiments. We propose a novel temporal/spatio-temporal Varying Coefficient Decision Process (VCDP) model, capable of effectively capturing the evolving treatment effects in situations characterized by temporal and/or spatial dependence. Our methodology encompasses the decomposition of the Average Treatment Effect (ATE) into the Direct Effect (DE) and the Indirect Effect (IE). We subsequently devise comprehensive procedures for estimating and making inferences about both DE and IE. Additionally, we provide a rigorous analysis of the statistical properties of these procedures, such as asymptotic power. To substantiate the effectiveness of our approach, we carry out extensive simulations and real data analyses.


title: Geometric phases acquired for a two-level atom coupled to fluctuating vacuum scalar fields due to linear acceleration and circular motion

abstract: In open quantum systems, we study the geometric phases acquired for a two-level atom coupled to a bath of fluctuating vacuum massless scalar fields due to linear acceleration and circular motion without and with a boundary. In free space, as we amplify acceleration, the geometric phase acquired purely due to linear acceleration case firstly is smaller than the circular acceleration case in the ultrarelativistic limit for the initial atomic state $\theta\in(0,\frac{\pi}{2})\cup(\frac{\pi}{2},\pi)$, then equals to the circular acceleration case in a certain acceleration, and finally, is larger than the circular acceleration case. The spontaneous transition rates show a similar feature. This result is different from the case of a bath of fluctuating vacuum electromagnetic fields that has been studied. Considering the initial atomic state $\theta \in(0,\pi)$, we find that the geometric phase acquired purely due to linear acceleration always equals to the circular acceleration case for the certain acceleration. The feature implies that, in a certain condition, one can simulate the case of the uniformly accelerated two-level atom by studying the properties of the two-level atom in circular motion. Adding a reflecting boundary, we observe that a larger value of a geometric phase can be obtained compared to the absence of a boundary. Besides, the geometric phase fluctuates along $z$, and the maximum of geometric phase is closer to the boundary for a larger acceleration. We also find that geometric phases can be acquired purely due to the linear acceleration case and circular acceleration case with $\theta \in(0,\pi)$ for a smaller $z$.


title: Resolving molecular diffusion and aggregation of antibody proteins with megahertz X-ray free-electron laser pulses

abstract: X-ray free-electron lasers (XFELs) with megahertz repetition rate can provide novel insights into structural dynamics of biological macromolecule solutions. However, very high dose rates can lead to beam-induced dynamics and structural changes due to radiation damage. Here, we probe the dynamics of dense antibody protein (Ig-PEG) solutions using megahertz X-ray photon correlation spectroscopy (MHz-XPCS) at the European XFEL. By varying the total dose and dose rate, we identify a regime for measuring the motion of proteins in their first coordination shell, quantify XFEL-induced effects such as driven motion, and map out the extent of agglomeration dynamics. The results indicate that for average dose rates below $1.06\,\mathrm{kGy}\mathrm{\mu s}^{-1}$ in a time window up to $10\,\mathrm{\mu s}$, it is possible to capture the protein dynamics before the onset of beam induced aggregation. We refer to this approach as correlation before aggregation and demonstrate that MHz-XPCS bridges an important spatio-temporal gap in measurement techniques for biological samples.


title: HiP: Hierarchical Perceiver

abstract: General perception systems such as Perceivers can process arbitrary modalities in any combination and are able to handle up to a few hundred thousand inputs. They achieve this generality by using exclusively global attention operations. This however hinders them from scaling up to the inputs sizes required to process raw high-resolution images or video. In this paper, we show that some degree of locality can be introduced back into these models, greatly improving their efficiency while preserving their generality. To scale them further, we introduce a self-supervised approach that enables learning dense low-dimensional positional embeddings for very large signals. We call the resulting model a Hierarchical Perceiver (HiP). In sum our contributions are: 1) scaling Perceiver-type models to raw high-resolution images and audio+video, 2) showing the feasibility of learning 1M+ positional embeddings from scratch using masked auto-encoding, 3) demonstrating competitive performance on raw data from ImageNet, AudioSet, PASCAL VOC, ModelNet40 and Kinetics datasets with the same exact, unchanged model and without specialized preprocessing or any tokenization.


title: Protecting GNSS-based Services using Time Offset Validation

abstract: Global navigation satellite systems (GNSS) provide pervasive accurate positioning and timing services for a large gamut of applications, from Time based One-Time Passwords (TOPT), to power grid and cellular systems. However, there can be security concerns for the applications due to the vulnerability of GNSS. It is important to observe that GNSS receivers are components of platforms, in principle having rich connectivity to different network infrastructures. Of particular interest is the access to a variety of timing sources, as those can be used to validate GNSS-provided location and time. Therefore, we consider off-the-shelf platforms and how to detect if the GNSS receiver is attacked or not, by cross-checking the GNSS time and time from other available sources. First, we survey different technologies to analyze their availability, accuracy, and trustworthiness for time synchronization. Then, we propose a validation approach for absolute and relative time. Moreover, we design a framework and experimental setup for the evaluation of the results. Attacks can be detected based on WiFi supplied time when the adversary shifts the GNSS provided time, more than 23.942us; with Network Time Protocol (NTP) supplied time when the adversary-induced shift is more than 2.046ms. Consequently, the proposal significantly limits the capability of an adversary to manipulate the victim GNSS receiver.


title: Optical Shadows of Rotating Bardeen AdS Black Holes

abstract: Using the Hamilton-Jacobi method, we study certain optical shadows of rotating Bardeen-AdS black holes in the presence of internal and external field contributions. Precisely, we examine the shadow using one-dimensional real curves. By establishing the equations of motion of such AdS black holes without external dark sectors, we first analyze the shadow configurations in terms of a reduced moduli space involving only internal parameter contributions including the charge of the nonlinear electrodynamics. Among others, we find that this parameter serves as a geometric quantity controlling the shadow shape. Then, we graphically discuss the associated astronomical observables. Enlarging the moduli space, we analyze the behaviors of the quintessential black hole solutions in terms of the involved parameters controlling the dark field sector. Concretely, we observe that the dark energy not only affects the size but also deforms the shadow shape. Finally, we provide a possible link with observations from Event Horizon Telescope by showing certain constraints on the involved moduli space in the light of the M87$^*$ picture.


title: Impact of Atrial Fibrillation on Left Atrium Haemodynamics: A Computational Fluid Dynamics Study

abstract: We analyze left atrium haemodynamics, highlighting differences among healthy individuals and patients affected by atrial fibrillation. The computational study is based on patient-specific geometries of the left atria to simulate blood flow dynamics. We devise a novel procedure aimed at recovering the boundary conditions for the 3D haemodynamics simulations, particularly useful in absence of specific ones provided by clinical measurements. With this aim, we introduce a parametric definition of the atria displacement, and we employ a closed-loop lumped parameter model of the whole cardiocirculatory system conveniently tuned on the basis of the patient characteristics. We evaluate a number of fluid dynamics indicators for the atrial haemodynamics, validating our numerical results in terms of several clinical measurements; we investigate the impact of geometrical and clinical features on the risk of thrombosis. To analyse the correlation of thrombus formation with atrial fibrillation, coherently with the medical evidence, we propose a novel indicator, which we call age stasis and that arises from the combination of Eulerian and Lagrangian quantities. This indicator identifies regions where the slow flow cannot rinse the chamber properly, accumulating stale blood particles and creating optimal conditions for clot formation.

categories: physics.flu-dyn cs.NA math.NA physics.med-ph


title: Quantum Internet Protocol Stack: a Comprehensive Survey

abstract: Classical Internet evolved exceptionally during the last five decades, from a network comprising a few static nodes in the early days to a leviathan interconnecting billions of devices. This has been possible by the separation of concern principle, for which the network functionalities are organized as a stack of layers, each providing some communication functionalities through specific network protocols. In this survey, we aim at highlighting the impossibility of adapting the classical Internet protocol stack to the Quantum Internet, due to the marvels of quantum mechanics. Indeed, the design of the Quantum Internet requires a major paradigm shift of the whole protocol stack for harnessing the peculiarities of quantum entanglement and quantum information. In this context, we first overview the relevant literature about Quantum Internet protocol stack. Then, stemming from this, we sheds the light on the open problems and required efforts toward the design of an effective and complete Quantum Internet protocol stack. To the best of authors' knowledge, a survey of this type is the first of its own. What emerges from this analysis is that the Quantum Internet, though still in its infancy, is a disruptive technology whose design requires an inter-disciplinary effort at the border between quantum physics, computer and telecommunications engineering.


title: Qualitative analysis on the critical points of the Robin function

abstract: Let $\Omega\subset\mathbb{R}^N$ be a smooth bounded domain with $N\ge2$ and $\Omega_\epsilon=\Omega\backslash B(P,\epsilon)$ where $B(P,\epsilon)$ is the ball centered at $P\in\Omega$ and radius $\epsilon$. In this paper, we establish the number, location and non-degeneracy of critical points of the Robin function in $\Omega_\epsilon$ for $\epsilon$ small enough. We will show that the location of $P$ plays a crucial role on the existence and multiplicity of the critical points. The proof of our result is a consequence of delicate estimates on the Green function near to $\partial B(P,\epsilon)$. Some applications to compute the exact number of solutions of related well-studied nonlinear elliptic problems will be showed.


title: Birefringence and dichroism effects in the spin noise spectra of a spin-1 system

abstract: We perform spin noise spectroscopy experiments in metastable helium atoms at room temperature, with a probe light whose frequency is blue detuned from the D0 line. Both circular birefringence fluctuations (Faraday noise) and linear birefringence fluctuations (ellipticity noise) are explored theoretically and experimentally. In particular, it is shown that in both cases but for different optical detunings, two noise resonances are isolated at the Larmor frequency and at twice the Larmor frequency with a behaviour, which strongly depends on the orientation of the probe field polarization. The simple structure of metastable helium allows us to probe, model and explain the changes in the behavior of these peaks in terms of circular and linear dichroisms and birefringences as well as in terms of spin oscillation modes.


title: DEMO: Relay/Replay Attacks on GNSS signals

abstract: Global Navigation Satellite Systems (GNSS) are ubiquitously relied upon for positioning and timing. Detection and prevention of attacks against GNSS have been researched over the last decades, but many of these attacks and countermeasures were evaluated based on simulation. This work contributes to the experimental investigation of GNSS vulnerabilities, implementing a relay/replay attack with off-the-shelf hardware. Operating at the signal level, this attack type is not hindered by cryptographically protected transmissions, such as Galileo's Open Signals Navigation Message Authentication (OS-NMA). The attack we investigate involves two colluding adversaries, relaying signals over large distances, to effectively spoof a GNSS receiver. We demonstrate the attack using off-the-shelf hardware, we investigate the requirements for such successful colluding attacks, and how they can be enhanced, e.g., allowing for finer adversarial control over the victim receiver.


title: Relational Algebra and Calculus with SQL Null Values

abstract: The logic of nulls in databases has been subject of investigation since their introduction in Codd's Relational Model, which is the foundation of the SQL standard. We show a logical characterisation of a first-order fragment of SQL with null values, by first focussing on a simple extension with null values of standard relational algebra, which captures exactly the SQL fragment, and then proposing two different domain relational calculi, in which the null value is a term of the language but it does not appear as an element of the semantic interpretation domain of the logics. In one calculus, a relation can be seen as a set of partial tuples, while in the other (equivalent) calculus, a relation is horizontally decomposed as a set of relations each one holding regular total tuples. We extend Codd's theorem by proving the equivalence of the relational algebra with both domain relational calculi in presence of SQL null values.


title: POSTER: Detecting GNSS misbehaviour with high-precision clocks

abstract: To mitigate spoofing attacks targeting global navigation satellite systems (GNSS) receivers, one promising method is to rely on alternative time sources, such as network-based synchronization, in order to detect clock offset discrepancies caused by GNSS attacks. However, in case of no network connectivity, such validation references would not be available. A viable option is to rely on a local time reference; in particular, precision hardware clock ensembles of chip-scale thermally stable oscillators with extended holdover capabilities. We present a preliminary design and results towards a custom device capable of providing a stable reference, with smaller footprint and cost compared to traditional precision clocks. The system is fully compatible with existing receiver architecture, making this solution feasible for most industrial scenarios. Further integration with network-based synchronization can provide a complete time assurance system, with high short- and long-term stability.


title: Some Wadati-Konno-Ichikawa type integrable systems and their constructions

abstract: A standard-form Wadati-Konno-Ichikawa(WKI) type integrable hierarchy is derived from a corresponding matrix spectral problem associated with the Lie algebra sl(2, R). Each equation in the resulting hierarchy has a bi-Hamiltonian structure furnished by the trace identity. Then, the higher grading affine algebraic construction of some special cases is proposed. We also show that eneralized short pulse equation arises naturally from the negative WKI flow.


title: On the influence of water on THz vibrational spectral features of molecular crystals

abstract: The nanoscale structure of molecular assemblies plays a major role in many ($\mu$)-biological mechanisms. Molecular crystals are one of the most simple of these assemblies and are widely used in a variety of applications from pharmaceuticals and agrochemicals, to nutraceuticals and cosmetics. The collective vibrations in such molecular crystals can be probed using terahertz spectroscopy, providing unique characteristic spectral fingerprints. However, the association of the spectral features to the crystal conformation, crystal phase and its environment is a difficult task. We present a combined computationalexperimental study on the incorporation of water in lactose molecular crystals, and show how simulations can be used to associate spectral features in the THz region to crystal conformations and phases. Using periodic DFT simulations of lactose molecular crystals, the role of water in the observed lactose THz spectrum is clarified, presenting both direct and indirect contributions. A specific experimental setup is built to allow the controlled heating and corresponding dehydration of the sample, providing the monitoring of the crystal phase transformation dynamics. Besides the observation that lactose phases and phase transformation appear to be more complex than previously thoughtincluding several crystal forms in a single phase and a non-negligible water content in the so-called anhydrous phasewe draw two main conclusions from this study. Firstly, THz modes are spread over more than one molecule and require periodic computation rather than a gas-phase one. Secondly, hydration water does not only play a perturbative role but also participates in the facilitation of the THz vibrations.


title: Coupled multiphysics analysis of a 4-vane RFQ accelerator under high power operation

abstract: The radiofrequency resonant four-quadrant mechanical structure of a 4-vane Radio Frequency Quadrupole (RFQ) has a high quality factor and narrow bandwidth, resulting in high sensitivity to frequency detuning caused by thermal expansion under high power operation, so minimization of frequency errors and affording dynamic tuning are very important design issues. Here we describe an optimization approach to figure out a suitable cooling design for a 4-vane RFQ in steady state. Besides, we investigate how the accelerator responds in transient thermal analysis that could help to guide commissioning and reduce frequency detuning. Multiphysics analysis utilized with CST and ANSYS for a recently developed 176 MHz 4-vane RFQ is taken as an example. This RFQ will dissipate 211 kW when reaching an inter-vane voltage of 80 kV, which is required for an acceleration of an 80-mA proton from 65 keV to 2.5 MeV in 5.3 meters.


title: Confident Neural Network Regression with Bootstrapped Deep Ensembles

abstract: With the rise of the popularity and usage of neural networks, trustworthy uncertainty estimation is becoming increasingly essential. One of the most prominent uncertainty estimation methods is Deep Ensembles (Lakshminarayanan et al., 2017) . A classical parametric model has uncertainty in the parameters due to the fact that the data on which the model is build is a random sample. A modern neural network has an additional uncertainty component since the optimization of the network is random. Lakshminarayanan et al. (2017) noted that Deep Ensembles do not incorporate the classical uncertainty induced by the effect of finite data. In this paper, we present a computationally cheap extension of Deep Ensembles for the regression setting, called Bootstrapped Deep Ensembles, that explicitly takes this classical effect of finite data into account using a modified version of the parametric bootstrap. We demonstrate through an experimental study that our method significantly improves upon standard Deep Ensembles


title: The near exact bin covering problem

abstract: We present a new generalization of the bin covering problem that is known to be a strongly NP-hard problem. In our generalization there is a positive constant $\Delta$, and we are given a set of items each of which has a positive size. We would like to find a partition of the items into bins. We say that a bin is near exact covered if the total size of items packed into the bin is between $1$ and $1+\Delta$. Our goal is to maximize the number of near exact covered bins. If $\Delta=0$ or $\Delta>0$ is given as part of the input, our problem is shown here to have no approximation algorithm with a bounded asymptotic approximation ratio (assuming that $P\neq NP$). However, for the case where $\Delta>0$ is seen as a constant, we present an asymptotic fully polynomial time approximation scheme (AFPTAS) that is our main contribution.


title: Modeling and Analysis of Heat Transfer and Fluid Flow Mechanisms in Nanofluid Filled Enclosures Irradiated from Below

abstract: Radiation driven transport mechanisms are ubiquitous in many natural flows and industrial processes. To mimic and to better understand these processes, recently, radiatively heated nanofluid filled enclosures have been extensively researched. The present work is essentially a determining step in quantifying and understanding the transport mechanisms involved in such enclosures. In particular, a two dimensional square nanofluid filled enclosure irradiated from the bottom has been investigated in laminar flow situation. Effects of nanofluid optical depth, inclination angle of the enclosure, incident flux, and boundary conditions (adiabatic and isothermal) have been investigated. Moreover, the temperature and flow fields have been carefully analyzed in the situation ranging from volumetric to mixed to surface absorption modes. Under adiabatic boundary conditions, steady state is unconditionally achieved irrespective of the incident flux magnitude (varied between 5Wm-2 to 50Wm-2), enclosure inclination angle (varied between 0 to 60 degrees) and mode of absorption (surface, mixed or volumetric). However, in case of isothermal boundaries; onset of natural convection and its transition into transient regime is significantly impacted by the mode of absorption and the enclosure inclination angle.


title: An ES-BGK model for diatomic gases with correct relaxation rates for internal energies

abstract: We propose a new ES-BGK model for diatomic gases which allows for translational-rotational and translational-vibrational energy exchanges, as given by Landau-Teller and Jeans relaxation equations. This model is consistent with the general definition of the vibrational and rotational collision numbers that are also commonly used in DSMC solvers. It is proved to satisfy the H-theorem and to give the correct transport coefficients, up to the volume viscosity.


title: On the functors associated with beaded open Jacobi diagrams

abstract: Morphisms in the linear category A of Jacobi diagrams in handlebodies give rise to interesting contravariant functors on the category gr of finitely-generated free groups, encoding part of the composition structure of the category A. These functors correspond, via an equivalence of categories given by Powell, to functors given by beaded open Jacobi diagrams. We study the polynomiality of these functors and whether they are outer functors. These results are inspired by and generalize previous results obtained by Katada.


title: Quantum walk in a reinforced free-energy landscape: Quantum annealing with reinforcement

abstract: Providing an optimal path to a quantum annealing algorithm is key to finding good approximate solutions to computationally hard optimization problems. Reinforcement is one of the strategies that can be used to circumvent the exponentially small energy gaps of the system in the annealing process. Here a time-dependent reinforcement term is added to the Hamiltonian in order to give lower energies to the most probable states of the evolving system. In this study, we take a local entropy in the configuration space for the reinforcement and apply the algorithm to a number of easy and hard optimization problems. The reinforced algorithm performs better than the standard quantum annealing algorithm in the quantum search problem, where the optimal parameters behave very differently depending on the number of solutions. Moreover, the reinforcements can change the discontinuous phase transitions of the mean-field p-spin model ($p>2$) to a continuous transition. The algorithm's performance in the binary perceptron problem is also superior to that of the standard quantum annealing algorithm, which already works better than a classical simulated annealing algorithm.


title: Integral points of bounded height on a certain toric variety

abstract: We determine an asymptotic formula for the number of integral points of bounded height on a certain toric variety, which is incompatible with part of a preprint by Chambert-Loir and Tschinkel. We provide an alternative interpretation of the asymptotic formula we get. To do so, we construct an analogue of Peyre's constant $\alpha$ and describe its relation to a new obstruction to the Zariski density of integral points in certain regions of varieties.


title: Sound Adversarial Audio-Visual Navigation

abstract: Audio-visual navigation task requires an agent to find a sound source in a realistic, unmapped 3D environment by utilizing egocentric audio-visual observations. Existing audio-visual navigation works assume a clean environment that solely contains the target sound, which, however, would not be suitable in most real-world applications due to the unexpected sound noise or intentional interference. In this work, we design an acoustically complex environment in which, besides the target sound, there exists a sound attacker playing a zero-sum game with the agent. More specifically, the attacker can move and change the volume and category of the sound to make the agent suffer from finding the sounding object while the agent tries to dodge the attack and navigate to the goal under the intervention. Under certain constraints to the attacker, we can improve the robustness of the agent towards unexpected sound attacks in audio-visual navigation. For better convergence, we develop a joint training mechanism by employing the property of a centralized critic with decentralized actors. Experiments on two real-world 3D scan datasets, Replica, and Matterport3D, verify the effectiveness and the robustness of the agent trained under our designed environment when transferred to the clean environment or the one containing sound attackers with random policy. Project: \url{https://yyf17.github.io/SAAVN}.


title: A tensor network discriminator architecture for classification of quantum data on quantum computers

abstract: We demonstrate the use of matrix product state (MPS) models for discriminating quantum data on quantum computers using holographic algorithms, focusing on classifying a translationally invariant quantum state based on $L$ qubits of quantum data extracted from it. We detail a process in which data from single-shot experimental measurements are used to optimize an isometric tensor network, the tensors are compiled into unitary quantum operations using greedy compilation heuristics, parameter optimization on the resulting quantum circuit model removes the post-selection requirements of the isometric tensor model, and the resulting quantum model is inferenced on either product state or entangled quantum data. We demonstrate our training and inference architecture on a synthetic dataset of six-site single-shot measurements from the bulk of a one-dimensional transverse field Ising model (TFIM) deep in its antiferromagnetic and paramagnetic phases. We experimentally evaluate models on Quantinuum's H1-2 trapped ion quantum computer using entangled input data modeled as translationally invariant, bond dimension 4 MPSs across the known quantum phase transition of the TFIM. Using linear regression on the experimental data near the transition point, we find predictions for the critical transverse field of $h=0.962$ and $0.994$ for tensor network discriminators of bond dimension $\chi=2$ and $\chi=4$, respectively. These predictions compare favorably with the known transition location of $h=1$ despite training on data far from the transition point. Our techniques identify families of short-depth variational quantum circuits in a data-driven and hardware-aware fashion and robust classical techniques to precondition the model parameters, and can be adapted beyond machine learning to myriad applications of tensor networks on quantum computers, such as quantum simulation and error correction.


title: Variation Aware Training of Hybrid Precision Neural Networks with 28nm HKMG FeFET Based Synaptic Core

abstract: This work proposes a hybrid-precision neural network training framework with an eNVM based computational memory unit executing the weighted sum operation and another SRAM unit, which stores the error in weight update during back propagation and the required number of pulses to update the weights in the hardware. The hybrid training algorithm for MLP based neural network with 28 nm ferroelectric FET (FeFET) as synaptic devices achieves inference accuracy up to 95% in presence of device and cycle variations. The architecture is primarily evaluated using behavioral or macro-model of FeFET devices with experimentally calibrated device variations and we have achieved accuracies compared to floating-point implementations.


title: Distributed Sparse Multicategory Discriminant Analysis

abstract: This paper proposes a convex formulation for sparse multicategory linear discriminant analysis and then extend it to the distributed setting when data are stored across multiple sites. The key observation is that for the purpose of classification it suffices to recover the discriminant subspace which is invariant to orthogonal transformations. Theoretically, we establish statistical properties ensuring that the distributed sparse multicategory linear discriminant analysis performs as good as the centralized version after {a few rounds} of communications. Numerical studies lend strong support to our methodology and theory.


title: Generalizing Dirichlet-to-Neumann operators

abstract: The aim of this paper is to study the Dirichlet-to-Neumann operators in the context of Dirichlet forms and especially to figure out their probabilistic counterparts. Regarding irreducible Dirichlet forms, we will show that the Dirichlet-to-Neumann operators for them are associated with the trace Dirichlet forms corresponding to the time changed processes on the boundary. Furthermore, the Dirichlet-to-Neumann operators for perturbations of Dirichlet forms will be also explored. It turns out that for typical cases such a Dirichlet-to-Neumann operator corresponds to a quasi-regular positivity preserving (symmetric) coercive form, so that there exists a family of Markov processes associated with it via Doob's $h$-transformations.


title: Learning-informed parameter identification in nonlinear time-dependent PDEs

abstract: We introduce and analyze a method of learning-informed parameter identification for partial differential equations (PDEs) in an all-at-once framework. The underlying PDE model is formulated in a rather general setting with three unknowns: physical parameter, state and nonlinearity. Inspired by advances in machine learning, we approximate the nonlinearity via a neural network, whose parameters are learned from measurement data. The later is assumed to be given as noisy observations of the unknown state, and both the state and the physical parameters are identified simultaneously with the parameters of the neural network. Moreover, diverging from the classical approach, the proposed all-at-once setting avoids constructing the parameter-to-state map by explicitly handling the state as additional variable. The practical feasibility of the proposed method is confirmed with experiments using two different algorithmic settings: A function-space algorithm based on analytic adjoints as well as a purely discretized setting using standard machine learning algorithms.


title: Remaining Useful Life Prediction Using Temporal Deep Degradation Network for Complex Machinery with Attention-based Feature Extraction

abstract: The precise estimate of remaining useful life (RUL) is vital for the prognostic analysis and predictive maintenance that can significantly reduce failure rate and maintenance costs. The degradation-related features extracted from the sensor streaming data with neural networks can dramatically improve the accuracy of the RUL prediction. The Temporal deep degradation network (TDDN) model is proposed to make the RUL prediction with the degradation-related features given by the one-dimensional convolutional neural network (1D CNN) feature extraction and attention mechanism. 1D CNN is used to extract the temporal features from the streaming sensor data. Temporal features have monotonic degradation trends from the fluctuating raw sensor streaming data. Attention mechanism can improve the RUL prediction performance by capturing the fault characteristics and the degradation development with the attention weights. The performance of the TDDN model is evaluated on the public C-MAPSS dataset and compared with the existing methods. The results show that the TDDN model can achieve the best RUL prediction accuracy in complex conditions compared to current machine learning models. The degradation-related features extracted from the high-dimension sensor streaming data demonstrate the clear degradation trajectories and degradation stages that enable TDDN to predict the turbofan-engine RUL accurately and efficiently.


title: Nanomechanical Design Strategy for Single-Mode Optomechanical Measurement

abstract: The motion of a mechanical resonator is intrinsically decomposed over a collection of normal modes of vibration. When the resonator is used as a sensor, its multimode nature often deteriorates or limits its performance and sensitivity. This challenge is frequently encountered in state-of-the-art optomechanical sensing platforms. We present a mechanical design strategy that ensures that optomechanical measurements can retrieve information on a single mechanical degree of freedom, and implement it in a sliced photonic crystal nanobeam resonator. A spectral design approach is used to make mechanical symmetries robust against practical disorder. The effectiveness of the method is evaluated by deriving a relevant figure of merit for continuous and pulsed measurement application scenarios. The method can be employed in any mechanical design that presents unwanted spurious mechanical modes. In the nanobeam platform, we experimentally show an increase of the signal to noise ratio of the mode of interest over the first spurious mode by four orders of magnitudes.


title: Honour Thesis: A Joint Value at Risk and Expected Shortfall Combination Framework and its Applications in the Cryptocurrency Market

abstract: Value at risk and expected shortfall are increasingly popular tail risk measures in the financial risk management field. Both academia and financial institutions are working to improve tail risk forecasts in order to meet the requirements of the Basel Capital Accord; it states that one purpose of risk management and measuring risk accuracy is, since extreme movements cannot always be avoided, financial institutions can prepare for these extreme returns by capital allocation, and putting aside the appropriate amount of capital so as to avoid default in times of extreme price or index movements. Forecast combination has drawn much attention, as a combined forecast can outperform the individual forecasts under certain conditions. We propose two methodology, one is a semiparametric combination framework that can jointly produce combined value at risk and expected shortfall forecasts, another one is a parametric regression framework named as Quantile-ES regression that can produce combined expected shortfall forecasts. The favourability of the semiparametric combination framework has been presented via an empirical study - application in cryptocurrency markets with high-frequency data where the necessity of risk management application increases as the cryptocurrency market becomes more popular and mature. Additionally, the general framework of the parametric Quantile-ES regression has been presented via a simulation study, whereas it still need to be improved in the future. The contributions of this work include but are not limited to the enabling of the combination of expected shortfall forecasts and the application of risk management procedures in the cryptocurrency market with high-frequency data.


title: Translational Quantum Machine Intelligence for Modeling Tumor Dynamics in Oncology

abstract: Quantifying the dynamics of tumor burden reveals useful information about cancer evolution concerning treatment effects and drug resistance, which play a crucial role in advancing model-informed drug developments (MIDD) towards personalized medicine and precision oncology. The emergence of Quantum Machine Intelligence offers unparalleled insights into tumor dynamics via a quantum mechanics perspective. This paper introduces a novel hybrid quantum-classical neural architecture named $\eta-$Net that enables quantifying quantum dynamics of tumor burden concerning treatment effects. We evaluate our proposed neural solution on two major use cases, including cohort-specific and patient-specific modeling. In silico numerical results show a high capacity and expressivity of $\eta-$Net to the quantified biological problem. Moreover, the close connection to representation learning - the foundation for successes of modern AI, enables efficient transferability of empirical knowledge from relevant cohorts to targeted patients. Finally, we leverage Bayesian optimization to quantify the epistemic uncertainty of model predictions, paving the way for $\eta-$Net towards reliable AI in decision-making for clinical usages.


title: Strong Cohomological rigidity of Bott manifolds

abstract: We show that the strong cohomological rigidity conjecture for Bott manifolds is true. Namely, any graded cohomology ring isomorphism between two Bott manifolds is induced by a diffeomorphism.


title: A Deep Learning Approach to Predicting Ventilator Parameters for Mechanically Ventilated Septic Patients

abstract: We develop a deep learning approach to predicting a set of ventilator parameters for a mechanically ventilated septic patient using a long and short term memory (LSTM) recurrent neural network (RNN) model. We focus on short-term predictions of a set of ventilator parameters for the septic patient in emergency intensive care unit (EICU). The short-term predictability of the model provides attending physicians with early warnings to make timely adjustment to the treatment of the patient in the EICU. The patient specific deep learning model can be trained on any given critically ill patient, making it an intelligent aide for physicians to use in emergent medical situations.


title: Simulation of crack propagation through voxel-based, heterogeneous structures based on eigenerosion and finite cells

abstract: This paper presents an algorithm for the efficient simulation of ductile crack propagation through heterogeneous structures, as e.g. metallic microstructures, which are given as voxel data. These kinds of simulations are required for e.g., the numerical investigation of wear mechanisms at small length scales, which is still a challenging task in engineering. The basic idea of the proposed algorithm is to combine the advantages of the Finite Cell Method allowing for a convenient integration of heterogeneous finite element problems with the eigenerosion approach to still enable the mesh-independent simulation of crack propagation. The major component is to switch from finite subcells to finite elements wherever the crack progresses, thereby automatically adaptively refining at the crack tip by managing the newly appearing nodes as hanging nodes. Technically relevant problems of crack propagation at the microscale are mostly linked with sub-critical crack growth where the crack moves fast and stepwise with subsequent load cycles. Therefore, inertia may become important which is why dynamics are taken into account by spreading the mass of the eroded elements to the nodes to avoid a loss in mass resulting from the erosion procedure. Furthermore, a certain treatment for the finite cell decomposition is considered in order to ensure efficiency and accuracy. The numerical framework as well as the voxel decomposition techniques are analyzed in detail in different three-dimensional numerical examples to show the performance of the proposed approach.


title: MSTGD:A Memory Stochastic sTratified Gradient Descent Method with an Exponential Convergence Rate

abstract: The fluctuation effect of gradient expectation and variance caused by parameter update between consecutive iterations is neglected or confusing by current mainstream gradient optimization algorithms.Using this fluctuation effect, combined with the stratified sampling strategy, this paper designs a novel \underline{M}emory \underline{S}tochastic s\underline{T}ratified Gradient Descend(\underline{MST}GD) algorithm with an exponential convergence rate. Specifically, MSTGD uses two strategies for variance reduction: the first strategy is to perform variance reduction according to the proportion p of used historical gradient, which is estimated from the mean and variance of sample gradients before and after iteration, and the other strategy is stratified sampling by category. The statistic \ $\bar{G}_{mst}$\ designed under these two strategies can be adaptively unbiased, and its variance decays at a geometric rate. This enables MSTGD based on $\bar{G}_{mst}$ to obtain an exponential convergence rate of the form $\lambda^{2(k-k_0)}$($\lambda\in (0,1)$,k is the number of iteration steps,$\lambda$ is a variable related to proportion p).Unlike most other algorithms that claim to achieve an exponential convergence rate, the convergence rate is independent of parameters such as dataset size N, batch size n, etc., and can be achieved at a constant step size.Theoretical and experimental results show the effectiveness of MSTGD


title: Surface waves and bulk Ruderman mode of a bosonic superfluid vortex crystal in the lowest Landau level

abstract: We determine and analyze collective normal modes of a finite disk-shaped two-dimensional vortex crystal formed in a compressible bosonic superfluid in an artificial magnetic field. Using the microscopic Gross-Pitaevskii theory in the lowest Landau level approximation, we generate vortex crystal ground states and solve the Bogoliubov-de Gennes equations for small amplitude collective oscillations. We find chiral surface waves that propagate at frequencies larger than those of the bulk Tkachenko modes. Furthermore, we study low frequency bulk excitations and identify a torsional Ruderman mode, which we find is well-described by a previously developed low-energy effective field theory.

categories: cond-mat.quant-gas nlin.PS physics.atom-ph quant-ph


title: Homotopy Cartan calculus and inner deformations of $A_\infty$-algebras

abstract: We consider inner deformations of families of $A_\infty$-algebras. With the help of noncommutative Cartan's calculus, we prove the invariance of Hochschild (co)homology under inner deformations. The invariance also holds for cyclic cohomology classes that satisfy some additional conditions. Applications to dg-algebras and QFT problems are briefly discussed.


title: Tunable critical Casimir forces counteract Casimir-Lifshitz attraction

abstract: Casimir forces in quantum electrodynamics emerge between microscopic metallic objects because of the confinement of the vacuum electromagnetic fluctuations occurring even at zero temperature. Their generalization at finite temperature and in material media are referred to as Casimir--Lifshitz forces. These forces are typically attractive, leading to the widespread problem of stiction between the metallic parts of micro- and nanodevices. Recently, repulsive Casimir forces have been experimentally realized but their reliance on specialized materials prevents their dynamic control and thus limits their further applicability. Here, we experimentally demonstrate that repulsive critical Casimir forces, which emerge in a critical binary liquid mixture upon approaching the critical temperature, can be used to actively control microscopic and nanoscopic objects with nanometer precision. We demonstrate this by using critical Casimir forces to prevent the stiction caused by the Casimir--Lifshitz forces. We study a microscopic gold flake above a flat gold-coated substrate immersed in a critical mixture. Far from the critical temperature, stiction occurs because of dominant Casimir--Lifshitz forces. Upon approaching the critical temperature, however, we observe the emergence of repulsive critical Casimir forces that are sufficiently strong to counteract stiction. This experimental demonstration can accelerate the development of micro- and nanodevices by preventing stiction as well as providing active control and precise tunability of the forces acting between their constituent parts.


title: Investigating Older Adults' Attitudes towards Crisis Informatics Tools: Opportunities for Enhancing Community Resilience during Disasters

abstract: The world population is projected to rapidly age over the next 30 years. Given the increasing digital technology adoption amongst older adults, researchers have investigated how technology can support aging populations. However, little work has examined how technology can support older adults during crises, despite increasingly common natural disasters, public health emergencies, and other crisis scenarios in which older adults are especially vulnerable. Addressing this gap, we conducted focus groups with older adults residing in coastal locations to examine to what extent they felt technology could support them during emergencies. Our findings characterize participants' desire for tools that enhance community resilience-local knowledge, preparedness, community relationships, and communication, that help communities withstand disasters. Further, older adults' crisis technology preferences were linked to their sense of control, social relationships, and digital readiness. We discuss how a focus on community resilience can yield crisis technologies that more effectively support older adults.


title: Towards Noncommutative Quantum Reality

abstract: The implications of the physical theory of quantum mechanics on the question of realism is much a subject of sustaining interest, while the background questions among physicists on how to think about all the theoretical notion and `interpretation' of the theory remains controversial. Through a careful analysis of the theoretical notions with the help of modern mathematical perspectives, we give here a picture of quantum mechanics, as the basic theory for `nonrelativistic' particle dynamics, that can be seen as being as much about the physical reality as classical mechanics itself. The key is to fully embrace the noncommutativity of the theory and see it as a notion about the reality of physical quantities. Quantum reality is then just a noncommutative version of the classical reality.


title: Electronic and magnetic properties of silicene monolayer under bi-axial mechanical strain: a first-principles study

abstract: Mechanical control of electronic and magnetic properties of 2D Van-der-Waals heterostructures gives new possibilities for further development of spintronics and information-related technologies. Using the density functional theory, we investigate the structural, electronic, and magnetic properties of silicene monolayer with substituted Chromium atoms and under a small biaxial strain ($-6\%< \epsilon < 8\%$). Our results indicate that the Cr-doped silicene nanosheets without strain have magnetic metallic, half-metallic or semiconducting properties depending on the type of substitution. We also show that the magnetic moments associated with the monomer and vertical dimer substitutions change very weakly with strain. However, the magnetic moment associated with the horizontal dimer substitution decreases when either compressive or tensile strain is applied to the system. Additionally, we show that the largest semiconductor band-gap is approximately 0.13 eV under zero strain for the vertical Cr-doped silicene. Finally, biaxial compressive strain leads to irregular changes in the magnetic moment for Cr vertical dimer substitution.


title: Transformation Coding: Simple Objectives for Equivariant Representations

abstract: We present a simple non-generative approach to deep representation learning that seeks equivariant deep embedding through simple objectives. In contrast to existing equivariant networks, our transformation coding approach does not constrain the choice of the feed-forward layer or the architecture and allows for an unknown group action on the input space. We introduce several such transformation coding objectives for different Lie groups such as the Euclidean, Orthogonal and the Unitary groups. When using product groups, the representation is decomposed and disentangled. We show that the presence of additional information on different transformations improves disentanglement in transformation coding. We evaluate the representations learnt by transformation coding both qualitatively and quantitatively on downstream tasks, including reinforcement learning.


title: Convergence Analysis of Structure-Preserving Numerical Methods Based on Slotboom Transformation for the Poisson--Nernst--Planck Equations

abstract: The analysis of structure-preserving numerical methods for the Poisson--Nernst--Planck (PNP) system has attracted growing interests in recent years. In this work, we provide an optimal rate convergence analysis and error estimate for finite difference schemes based on the Slotboom reformulation. Different options of mobility average at the staggered mesh points are considered in the finite-difference spatial discretization, such as the harmonic mean, geometric mean, arithmetic mean, and entropic mean. A semi-implicit temporal discretization is applied, which in turn results in a non-constant coefficient, positive-definite linear system at each time step. A higher order asymptotic expansion is applied in the consistency analysis, and such a higher order consistency estimate is necessary to control the discrete maximum norm of the concentration variables. In convergence estimate, the harmonic mean for the mobility average, which turns out to bring lots of convenience in the theoretical analysis, is taken for simplicity, while other options of mobility average would also lead to the desired error estimate, with more technical details involved. As a result, an optimal rate convergence analysis on concentrations, electric potential, and ionic fluxes is derived, which is the first such results for the structure-preserving numerical schemes based on the Slotboom reformulation. It is remarked that the convergence analysis leads to a theoretical justification of the conditional energy dissipation analysis, which relies on the maximum norm bounds of the concentration and the gradient of the electric potential. Some numerical results are also presented to demonstrate the accuracy and structure-preserving performance of the associated schemes.


title: Broadband single-mode planar waveguides in monolithic 4H-SiC

abstract: Color-center defects in silicon carbide promise opto-electronic quantum applications in several fields, such as computing, sensing and communication. In order to scale down and combine these functionalities with the existing silicon device platforms, it is crucial to consider SiC integrated optics. In recent years many examples of SiC photonic platforms have been shown, like photonic crystal cavities, film-on-insulator waveguides and micro-ring resonators. However, all these examples rely on separating thin films of SiC from substrate wafers. This introduces significant surface roughness, strain and defects in the material, which greatly affects the homogeneity of the optical properties of color centers. Here we present and test a method for fabricating monolithic single-crystal integrated-photonic devices in SiC: tuning optical properties via charge carrier concentration. We fabricated monolithic SiC n-i-n and p-i-n junctions where the intrinsic layer acts as waveguide core, and demonstrate the waveguide functionality for these samples. The propagation losses are below 14 dB/cm. These waveguide types allow for addressing color-centers over a broad wavelength range with low strain-induced inhomogeneity of the optical-transition frequencies. Furthermore, we expect that our findings open the road to fabricating waveguides and devices based on p-i-n junctions, which will allow for integrated electrostatic and radio frequency (RF) control together with high-intensity optical control of defects in silicon carbide.

categories: physics.optics cond-mat.mes-hall physics.app-ph quant-ph


title: Multi-bit quantum random number generator from path-entangled single photons

abstract: Measurement outcomes on quantum systems exhibit inherent randomness and are fundamentally nondeterministic. This has enabled quantum physics to set new standards for the generation of true randomness with significant applications in the fields of cryptography, statistical simulations, and modeling of the nondeterministic behavior in various other fields. In this work, we present a scheme for the generation of multi-bit random numbers using path-entangled single photons. Without losing their intrinsic randomness, the protocol allows us to engineer the distribution from which we sample random numbers. For the experimental demonstration, we use single photons generated using spontaneous parametric down-conversion (SPDC), and assign a multi-bit commitment along the path. One-bit and two-bit random numbers are then generated from measuring entangled states in the path basis. In addition to passing the NIST tests for randomness, we also demonstrate the certification of quantumness and self-certification of quantum random number generator (QRNG) using Clauser, Horne, Shimony and Holt (CHSH) inequality violation. The path-entangled states can generate higher bitrates compared to heralded single photon or entangled photon schemes which are limited by the coincidence counts. The scheme involves distribution of photons along multiple paths resulting in multiple bits from one photon and avoids the limitation imposed by the detection dead time of one detector. We demonstrate this by generating a high rate of about 80 Mbps when the single photon detector saturates at around 28 Mcps.


title: Letters of the Alphabet: Discovering Natural Feature Sets

abstract: Deep learning networks find intricate features in large datasets using the backpropagation algorithm. This algorithm repeatedly adjusts the network connections.' weights and examining the "hidden" nodes behavior between the input and output layer provides better insight into how neural networks create feature representations. Experiments built on each other show that activity differences computed within a layer can guide learning. A simple neural network is used, which includes a data set comprised of the alphabet letters, where each letter forms 81 input nodes comprised of 0 and 1s and a single hidden layer and an output layer. The first experiment explains how the hidden layers in this simple neural network represent the input data's features. The second experiment attempts to reverse-engineer the neural network to find the alphabet's natural feature sets. As the network interprets features, we can understand how it derives the natural feature sets for a given data. This understanding is essential to delve deeper into deep generative models, such as Boltzmann machines. Deep generative models are a class of unsupervised deep learning algorithms. The primary function of deep generative models is to find the natural feature sets for a given data set.


title: EF-Train: Enable Efficient On-device CNN Training on FPGA Through Data Reshaping for Online Adaptation or Personalization

abstract: Conventionally, DNN models are trained once in the cloud and deployed in edge devices such as cars, robots, or unmanned aerial vehicles (UAVs) for real-time inference. However, there are many cases that require the models to adapt to new environments, domains, or new users. In order to realize such domain adaption or personalization, the models on devices need to be continuously trained on the device. In this work, we design EF-Train, an efficient DNN training accelerator with a unified channel-level parallelism-based convolution kernel that can achieve end-to-end training on resource-limited low-power edge-level FPGAs. It is challenging to implement on-device training on resource-limited FPGAs due to the low efficiency caused by different memory access patterns among forward, backward propagation, and weight update. Therefore, we developed a data reshaping approach with intra-tile continuous memory allocation and weight reuse. An analytical model is established to automatically schedule computation and memory resources to achieve high energy efficiency on edge FPGAs. The experimental results show that our design achieves 46.99 GFLOPS and 6.09GFLOPS/W in terms of throughput and energy efficiency, respectively.


title: A Survey of Vision-Language Pre-Trained Models

abstract: As transformer evolves, pre-trained models have advanced at a breakneck pace in recent years. They have dominated the mainstream techniques in natural language processing (NLP) and computer vision (CV). How to adapt pre-training to the field of Vision-and-Language (V-L) learning and improve downstream task performance becomes a focus of multimodal learning. In this paper, we review the recent progress in Vision-Language Pre-Trained Models (VL-PTMs). As the core content, we first briefly introduce several ways to encode raw images and texts to single-modal embeddings before pre-training. Then, we dive into the mainstream architectures of VL-PTMs in modeling the interaction between text and image representations. We further present widely-used pre-training tasks, and then we introduce some common downstream tasks. We finally conclude this paper and present some promising research directions. Our survey aims to provide researchers with synthesis and pointer to related research.


title: An end-to-end predict-then-optimize clustering method for intelligent assignment problems in express systems

abstract: Express systems play important roles in modern major cities. Couriers serving for the express system pick up packages in certain areas of interest (AOI) during a specific time. However, future pick-up requests vary significantly with time. While the assignment results are generally static without changing with time. Using the historical pick-up request number to conduct AOI assignment (or pick-up request assignment) for couriers is thus unreasonable. Moreover, even we can first predict future pick-up requests and then use the prediction results to conduct the assignments, this kind of two-stage method is also impractical and trivial, and exists some drawbacks, such as the best prediction results might not ensure the best clustering results. To solve these problems, we put forward an intelligent end-to-end predict-then-optimize clustering method to simultaneously predict the future pick-up requests of AOIs and assign AOIs to couriers by clustering. At first, we propose a deep learning-based prediction model to predict order numbers on AOIs. Then a differential constrained K-means clustering method is introduced to cluster AOIs based on the prediction results. We finally propose a one-stage end-to-end predict-then-optimize clustering method to assign AOIs to couriers reasonably, dynamically, and intelligently. Results show that this kind of one-stage predict-then-optimize method is beneficial to improve the performance of optimization results, namely the clustering results. This study can provide critical experiences for predict-and-optimize related tasks and intelligent assignment problems in express systems.