title: Quantum repeaters with encoding on nitrogen-vacancy center platforms

abstract: We investigate quantum repeater protocols that rely on three-qubit repetition codes using nitrogen-vacancy (NV) centers in diamond as quantum memories. NV centers offer a two-qubit register, corresponding to their electron and nuclear spins, which makes it possible to perform deterministic two-qubit operations within one NV center. For quantum repeater applications, we, however, need to do joint operations on two separate NV centers. Here, we study two NV-center based repeater structures that enable such deterministic joint operations. One structure offers less consumption of classical communication, at the cost of more computation overhead, whereas the other one relies on a fewer number of physical resources and operations. We assess and compare their performance for the task of secret key generation under the influence of noise and decoherence with current and near-term experimental parameters. We quantify the regimes of operation, where one structure outperforms the other, and find the regions where encoded quantum repeaters offer practical advantages over their non-encoded counterparts.


title: Wave-like exact models with symmetry of spatial homogeneity in the quadratic theory of gravity with a scalar field

abstract: Exact solutions are obtained in the quadratic theory of gravity with a scalar field for wave-like models of space-time with spatial homogeneity symmetry and allowing the integration of the equations of motion of test particles in the Hamilton-Jacobi formalism by the method of separation of variables with separation of wave variables (Shapovalov spaces of type II). The form of the scalar field and the scalar field functions included in the Lagrangian of the theory is found. The obtained exact solutions can describe the primary gravitational wave disturbances in the Universe (primary gravitational waves).


title: Improved Lower Bounds for Global Polynomial Optimisation

abstract: We present a branch-and-bound algorithm to improve the lower bounds obtained by SONC/SAGE. The running time is fixed-parameter tractable in the number of variables. Furthermore, we describe a new heuristic to obtain a candidate for the global minimum of a multivariate polynomial, based on its SONC decomposition. Applying this approach to thousands of test cases, we mostly obtain small duality gaps. In particular, we optimally solve the global minimisation problem in about 70% of the investigated cases.


title: Joint Optimization of Multi-Objective Reinforcement Learning with Policy Gradient Based Algorithm

abstract: Many engineering problems have multiple objectives, and the overall aim is to optimize a non-linear function of these objectives. In this paper, we formulate the problem of maximizing a non-linear concave function of multiple long-term objectives. A policy-gradient based model-free algorithm is proposed for the problem. To compute an estimate of the gradient, a biased estimator is proposed. The proposed algorithm is shown to achieve convergence to within an $\epsilon$ of the global optima after sampling $\mathcal{O}(\frac{M^4\sigma^2}{(1-\gamma)^8\epsilon^4})$ trajectories where $\gamma$ is the discount factor and $M$ is the number of the agents, thus achieving the same dependence on $\epsilon$ as the policy gradient algorithm for the standard reinforcement learning.


title: Exact nonlinear solutions for three-dimensional Alfv\'en-wave packets in relativistic magnetohydrodynamics

abstract: We show that large-amplitude, non-planar, Alfv\'en wave (AW) packets are exact nonlinear solutions of the relativistic MHD equations when the total magnetic-field strength in the local fluid rest frame ($b$) is a constant. We derive analytic expressions relating the components of the fluctuating velocity and magnetic field. We also show that these constant-$b$ AWs propagate without distortion at the relativistic Alfv\'en velocity and never steepen into shocks. These findings and the observed abundance of large-amplitude, constant-$b$ AWs in the solar wind suggest that such waves may be present in relativistic outflows around compact astrophysical objects.


title: Risk-Aware Transfer in Reinforcement Learning using Successor Features

abstract: Sample efficiency and risk-awareness are central to the development of practical reinforcement learning (RL) for complex decision-making. The former can be addressed by transfer learning and the latter by optimizing some utility function of the return. However, the problem of transferring skills in a risk-aware manner is not well-understood. In this paper, we address the problem of risk-aware policy transfer between tasks in a common domain that differ only in their reward functions, in which risk is measured by the variance of reward streams. Our approach begins by extending the idea of generalized policy improvement to maximize entropic utilities, thus extending policy improvement via dynamic programming to sets of policies and levels of risk-aversion. Next, we extend the idea of successor features (SF), a value function representation that decouples the environment dynamics from the rewards, to capture the variance of returns. Our resulting risk-aware successor features (RaSF) integrate seamlessly within the RL framework, inherit the superior task generalization ability of SFs, and incorporate risk-awareness into the decision-making. Experiments on a discrete navigation domain and control of a simulated robotic arm demonstrate the ability of RaSFs to outperform alternative methods including SFs, when taking the risk of the learned policies into account.


title: New $[SU(3)]^4$ Realization of Lepton/Dark Symmetry

abstract: Extending the well-known $SU(3)_C \times SU(3)_L \times SU(3)_R$ model of quarks and leptons to include a fourth $SU(3)_N$ gauge factor, a new realization is obtained, different from leptonic color, which contains a lepton/dark symmetry with the help of an input $Z_4$ symmetry. It is seen to encompass a previous extension of the standard model to $SU(2)_N$ lepton symmetry.


title: Lower central series and split extensions

abstract: Following Lazard, we study the $N$-series of a group $G$ and their associated graded Lie algebras. The main examples we consider are the lower central series and Stallings' rational and mod-$p$ versions of this series. Building on the work of Massuyeau and Guaschi-Pereiro, we describe these $N$-series and Lie algebras in the case when $G$ splits as a semidirect product, in terms of the relevant data for the factors and the monodromy action. As applications, we recover a well-known theorem of Falk-Randell regarding split extensions with trivial monodromy on abelianization and its mod-$p$ version due to Bellingeri-Gervais and prove an analogous result for the rational lower central series of split extensions with trivial monodromy on torsion-free abelianization.


title: 3D U-NetR: Low Dose Computed Tomography Reconstruction via Deep Learning and 3 Dimensional Convolutions

abstract: In this paper, we introduced a novel deep learning-based reconstruction technique for low-dose CT imaging using 3 dimensional convolutions to include the sagittal information unlike the existing 2 dimensional networks which exploits correlation only in transverse plane. In the proposed reconstruction technique, sparse and noisy sinograms are back-projected to the image domain with FBP operation, then the denoising process is applied with a U-Net like 3-dimensional network called 3D U-NetR. The proposed network is trained with synthetic and real chest CT images, and 2D U-Net is also trained with the same dataset to show the importance of the third dimension in terms of recovering the fine details. The proposed network shows better quantitative performance on SSIM and PSNR, especially in the real chest CT data. More importantly, 3D U-NetR captures medically critical visual details that cannot be visualized by a 2D network on the reconstruction of real CT images with 1/10 of the normal dose.


title: Hydraulic Fracturing of Poorly Consolidated Reservoir During Waterflooding

abstract: This paper describes a KGD-type model of a hydraulic fracture created by injecting fluid in weak, poorly consolidated rocks. The model is based on the key assumption that the hydraulic fracture is propagating within a domain where the hydraulic fields are quasi-stationary. By further assuming a negligible toughness, the fracture is shown to grow as a square root of time. The asymptotic fracture propagation regimes at small and large time are constructed and the transient solution is computed by solving a nonlinear system of algebraic equations formulated in terms of the fracture aperture. At early time the fracture is hydraulically invisible and the injection pressure increases with time $t$ as $\log t$, while at late time leak-off from the borehole is negligible and the injection pressure decreases as $t^{-1/4}$. According to this model, the peak injection pressure observed when injecting fluid in weak, poorly consolidated rocks should not be interpreted as indicating a breakdown of the formation, but rather as marking the transition between two asymptotic flow regimes. The timescale that legislates the transition between the small and large time asymptotic regimes is shown to be a strongly nonlinear function of a dimensionless injection rate.


title: Contextuality in the Bundle Approach, n-Contextuality, and the Role of Holonomy

abstract: Contextuality can be understood as the impossibility to construct a globally consistent description of a model even if there is local agreement. In particular, quantum models present this property. We can describe contextuality with the bundle approach, where the scenario is represented as a simplicial complex, the fibers being the sets of outcomes, and contextuality as the non-existence of global section in the measure bundle. Using the generalization to non-finite outcome fibers, we built in details the concept of measure bundle, demonstrating the Fine-Abramsky-Brandenburger theorem for the bundle formalism. We introduce a hierarchy called n-contextuality to explore the dependence of contextual behavior of a model to the topology of the scenario, following the construction of it as a simplicial complex. With it we exemplify the dependence on higher homology groups and show that GHZ models, thus quantum theory, has all levels of the hierarchy. Also, we give an example of how non-trivial topology of the scenario result an increase of contextual behavior. For the first level of the hierarchy, we construct the concept of connection through Markov operators for the measure bundle. Taking the case of equal fibers we can identify the outcomes as the basis of a vector space, that transform according to a group extracted from the connection. We thus show that contextuality has a relationship with the non-triviality of the holonomy group in the frame bundle.


title: A Combined Machine-Learning / Optimization-Based Approach for Inverse Design of Nonuniform Bianisotropic Metasurfaces

abstract: Electromagnetic metasurface design based on far-field constraints without the complete knowledge of the fields on both sides of the metasurface is typically a time consuming and iterative process, which relies heavily on heuristics and ad hoc methods. This paper proposes an end-to-end systematic and efficient approach where the designer inputs high-level far-field constraints such as nulls, sidelobe levels, and main beam level(s); and a 3-layer non-uniform passive, lossless, omega-type bianisotropic electromagnetic metasurface design to satisfy them is returned. The surface parameters to realize the far-field criteria are found using the alternating direction method of multipliers on a homogenized model derived from the method of moments. This model incorporates edge effects of the finite surface and mutual coupling in the inhomogeneous impedance sheet. Optimization through the physical unit cell space integrated with machine learning-based surrogate models is used to realize the desired surface parameters from physical meta-atom (or unit cell) designs. Two passive lossless examples with different feeding systems and far-field constraints are shown to demonstrate the effectiveness of this method.


title: Recommendations and Results Organization in Netflix Search

abstract: Personalized recommendations on the Netflix Homepage are based on a user's viewing habits and the behavior of similar users. These recommendations, organized for efficient browsing, enable users to discover the next great video to watch and enjoy without additional input or an explicit expression of their intents or goals. The Netflix Search experience, on the other hand, allows users to take active control of discovering new videos by explicitly expressing their entertainment needs via search queries. In this talk, we discuss the importance of producing search results that go beyond traditional keyword-matches to effectively satisfy users' search needs in the Netflix entertainment setting. Motivated by users' various search intents, we highlight the necessity to improve Search by applying approaches that have historically powered the Homepage. Specifically, we discuss our approach to leverage recommendations in the context of Search and to effectively organize search results to provide a product experience that meaningfully adds value for our users.


title: Phoneme-Based Ratio Mask Estimation for Reverberant Speech Enhancement in Cochlear Implant Processors

abstract: Cochlear implant (CI) users have considerable difficulty in understanding speech in reverberant listening environments. Time-frequency (T-F) masking is a common technique that aims to improve speech intelligibility by multiplying reverberant speech by a matrix of gain values to suppress T-F bins dominated by reverberation. Recently proposed mask estimation algorithms leverage machine learning approaches to distinguish between target speech and reverberant reflections. However, the spectro-temporal structure of speech is highly variable and dependent on the underlying phoneme. One way to potentially overcome this variability is to leverage explicit knowledge of phonemic information during mask estimation. This study proposes a phoneme-based mask estimation algorithm, where separate mask estimation models are trained for each phoneme. Sentence recognition tests were conducted in normal hearing listeners to determine whether a phoneme-based mask estimation algorithm is beneficial in the ideal scenario where perfect knowledge of the phoneme is available. The results showed that the phoneme-based masks improved the intelligibility of vocoded speech when compared to conventional phoneme-independent masks. The results suggest that a phoneme-based speech enhancement strategy may potentially benefit CI users in reverberant listening environments.


title: Towards a modeling and analysis environment for industrial IoT systems

abstract: The development of Industrial Internet of Things systems (IIoT) requires tools robust enough to cope with the complexity and heterogeneity of such systems, which are supposed to work in safety-critical conditions. The availability of methodologies to support early analysis, verification, and validation is still an open issue in the research community. The early real-time schedulability analysis can help quantify to what extent the desired system's timing performance can eventually be achieved. In this paper, we present CHESSIoT, a model-driven environment to support the design and analysis of industrial IoT systems. CHESSIoT follows a multi-view, component-based modelling approach with a comprehensive way to perform event-based modelling on system components for code generation purposes employing an intermediate ThingML model. To showcase the capability of the extension, we have designed and analysed an Industrial real-time safety use case.


title: What Makes a Game High-rated? Towards Factors of Video Game Success

abstract: As the video game market grows larger, it becomes harder to stand out from the crowd. Launching a successful game involves different aspects. But what are they? In this paper, we investigate some aspects of the high-rated games from a dataset of 200 projects. The results show that the none of the aspects of this study have a strong relationship with the game's success. A further analysis on the high-rated games shows that team, technical, and game-design aspects should be the main focus of the game developers.


title: Transformer-Based Source-Free Domain Adaptation

abstract: In this paper, we study the task of source-free domain adaptation (SFDA), where the source data are not available during target adaptation. Previous works on SFDA mainly focus on aligning the cross-domain distributions. However, they ignore the generalization ability of the pretrained source model, which largely influences the initial target outputs that are vital to the target adaptation stage. To address this, we make the interesting observation that the model accuracy is highly correlated with whether or not attention is focused on the objects in an image. To this end, we propose a generic and effective framework based on Transformer, named TransDA, for learning a generalized model for SFDA. Specifically, we apply the Transformer as the attention module and inject it into a convolutional network. By doing so, the model is encouraged to turn attention towards the object regions, which can effectively improve the model's generalization ability on the target domains. Moreover, a novel self-supervised knowledge distillation approach is proposed to adapt the Transformer with target pseudo-labels, thus further encouraging the network to focus on the object regions. Experiments on three domain adaptation tasks, including closed-set, partial-set, and open-set adaption, demonstrate that TransDA can greatly improve the adaptation accuracy and produce state-of-the-art results. The source code and trained models are available at https://github.com/ygjwd12345/TransDA.


title: On a class of data-driven mixed-integer programming problems under uncertainty: a distributionally robust approach

abstract: In this study we analyze linear mixed-integer programming problems, in which the distribution of the cost vector is only observable through a finite training data set. In contrast to the related studies, we assume that the number of random observations for each component of the cost vector may vary. Then the goal is to find a prediction rule that converts the data set into an estimate of the expected value of the objective function and a prescription rule that provides an associated estimate of the optimal decision. We aim at finding the least conservative prediction and prescription rules, which satisfy some specified asymptotic guarantees as the sample size tends to infinity. We demonstrate that under some mild assumption the resulting vector optimization problems admit a Pareto optimal solution with some attractive theoretical properties. In particular, this solution can be obtained by solving a distributionally robust optimization (DRO) problem with respect to all probability distributions with given component-wise relative entropy distances from the empirical marginal distributions. It turns out that the outlined DRO problem can be solved rather effectively whenever there exists an effective algorithm for the respective deterministic problem. In addition, we perform numerical experiments where the out-of-sample performance of the proposed approach is analyzed.


title: A Community Exoplanet Imaging Data Challenge for Roman CGI and Starshade Rendezvous

abstract: Operating in an unprecedented contrast regime ($10^{-7}$ to $10^{-9}$), the Roman Coronagraph Instrument (CGI) will serve as a pathfinder for key technologies needed for future Earth-finding missions. The Roman Exoplanet Imaging Data Challenge (Roman EIDC) was a community engagement effort that tasked participants with extracting exoplanets and their orbits for a 47 UMa-like target star, given: (1) 15 years of simulated precursor radial velocity (RV) data, and (2) six epochs of simulated imaging taken over the course of the Roman mission. The Roman EIDC simulated images include 4 epochs with CGI's Hybrid Lyot Coronagraph (HLC) plus 2 epochs with a starshade (SS) assumed to arrive as part of a Starshade Rendezvous later in the mission. Here, we focus on our in-house analysis of the outermost planet, for which the starshade's higher throughput and lower noise floor present a factor of ~4 improvement in signal-to-noise ratio over the narrow-field HLC. We find that, although the RV detection was marginal, the precursor RV data enable the mass and orbit to be constrained with only 2 epochs of starshade imaging. Including the HLC images in the analysis results in improved measurements over RV + SS alone, with the greatest gains resulting from images taken at epochs near maximum elongation. Combining the two epochs of SS imaging with the RV + HLC data resulted in a factor of ~2 better orbit and mass determinations over RV + HLC alone. The Roman CGI, combined with precursor RV data and later mission SS imaging, form a powerful trifecta in detecting exoplanets and determining their masses, albedos, and system configurations. While the Roman CGI will break new scientific and technological ground with direct imaging of giant exoplanets within ~5 AU of V~5 and brighter stars, a Roman Starshade Rendezvous mission would additionally enable the detection of planets out to ~8 AU in those systems.


title: ARMS: Antithetic-REINFORCE-Multi-Sample Gradient for Binary Variables

abstract: Estimating the gradients for binary variables is a task that arises frequently in various domains, such as training discrete latent variable models. What has been commonly used is a REINFORCE based Monte Carlo estimation method that uses either independent samples or pairs of negatively correlated samples. To better utilize more than two samples, we propose ARMS, an Antithetic REINFORCE-based Multi-Sample gradient estimator. ARMS uses a copula to generate any number of mutually antithetic samples. It is unbiased, has low variance, and generalizes both DisARM, which we show to be ARMS with two samples, and the leave-one-out REINFORCE (LOORF) estimator, which is ARMS with uncorrelated samples. We evaluate ARMS on several datasets for training generative models, and our experimental results show that it outperforms competing methods. We also develop a version of ARMS for optimizing the multi-sample variational bound, and show that it outperforms both VIMCO and DisARM. The code is publicly available.


title: Reconfigurable Intelligent Surface-assisted Multi-UAV Networks: Efficient Resource Allocation with Deep Reinforcement Learning

abstract: In this paper, we propose reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of UAV's agility and RIS's reflection for enhancing the network's performance. To aim at maximising the energy efficiency (EE) of the considered networks, we jointly optimise the power allocation of the UAVs and the phase-shift matrix of the RIS. A deep reinforcement learning (DRL) approach is proposed for solving the continuous optimisation problem with time-varying channels in a centralised fashion. Moreover, a parallel learning approach is also proposed for reducing the information transmission requirement of the centralised approach. Numerical results show a significant improvement of our proposed schemes compared with the conventional approaches in terms of EE, flexibility, and processing time. Our proposed DRL methods for RIS-assisted UAV networks can be used for real-time applications due to their capability of instant decision-making and handling the time-varying channel with the dynamic environmental setting.


title: Parallel server systems with cancel-on-completion redundancy

abstract: We consider a parallel server system with so-called cancel-on-completion redundancy. There are $n$ servers and multiple job classes $j$. An arriving class $j$ job consists of $d_j$ components, placed on a randomly selected subset of servers; the job service is complete as soon as $k_j$ components out of $d_j$ (with $k_j \le d_j$) complete their service, at which point the unfinished service of all remaining $d_j-k_j$ components is canceled. The system is in general non-work-conserving, in the sense that the average amount of new workload added to the system by an arriving class $j$ job is not defined a priori -- it depends on the system state at the time of arrival. This poses the main challenge for the system analysis. For the system with a fixed number of servers $n$ our main results include: the stability properties; the property that the stationary distributions of the relative server workloads remain tight, uniformly in the system load. We also consider the mean-field asymptotic regime when $n\to\infty$ while each job class arrival rate per server remains constant. The main question we address here is: under which conditions the steady-state asymptotic independence (SSAI) of server workloads holds, and in particular when the SSAI for the full range of loads (SSAI-FRL) holds. (Informally, SSAI-FRL means that SSAI holds for any system load less than $1$.) We obtain sufficient conditions for SSAI and SSAI-FRL. In particular, we prove that SSAI-FRL holds in the important special case when job components of each class $j$ are i.i.d. with an increasing-hazard-rate distribution.


title: A mechanism of Individualistic Indirect Reciprocity with internal and external dynamics

abstract: The cooperation mechanism of indirect reciprocity has been studied by making multiple variations of its parts. This research proposes a new variant of Nowak and Sigmund model, focused on agents' attitude; it is called Individualistic Indirect Reciprocity. In our model, an agent reinforces its strategy to the extent to which it makes a profit. We also include conditions related to the environment, visibility of agents, cooperation demand, and the attitude of an agent to maintain his cooperation strategy. Using Agent-Based Model and a Data Science method, we show on simulation results that the discriminatory stance of the agents prevails in most cases. In general, cooperators only appear in conditions with low visibility of reputation and a high degree of cooperation demand. The results also show that when the reputation of others is unknown, with a high obstinacy and high cooperation demand, a heterogeneous society is obtained. The simulations show a wide diversity of scenarios, centralized, polarized, and mixed societies.


title: Introducing the Voxel Interactive Contour Tool for Online Radiation Intensity Analytics (VICTORIA)

abstract: In this paper, the Voxel Interactive Contour Tool for Online Radiation Intensity Analytics (VICTORIA) web viewer is presented as a solution to the issue of inaccessible, expensive, and insecure Digital Imaging and Communications in Medicine (DICOM) and Monte Carlo (MC) dose viewers. VICTORIA is a tool for the visualization and comparison of dose distributions with underlying anatomy that is accessible, free, designed with security in mind, and available on the web. The code is open-source and under the GNU General Public License, and it can be found at the EGSnrc Github repo in the DICOM-viewer branch. The viewer should be useful for researchers using EGSnrc file types .egsphant and .3ddose from the EGSnrc toolkit, patients who want a simple tool to view files, or researchers using DICOM Computed Tomography (CT) and DICOM Radiotherapy (RT) Dose files in low- or middle-income countries without access to treatment planning systems.


title: Deep Fair Discriminative Clustering

abstract: Deep clustering has the potential to learn a strong representation and hence better clustering performance compared to traditional clustering methods such as $k$-means and spectral clustering. However, this strong representation learning ability may make the clustering unfair by discovering surrogates for protected information which we empirically show in our experiments. In this work, we study a general notion of group-level fairness for both binary and multi-state protected status variables (PSVs). We begin by formulating the group-level fairness problem as an integer linear programming formulation whose totally unimodular constraint matrix means it can be efficiently solved via linear programming. We then show how to inject this solver into a discriminative deep clustering backbone and hence propose a refinement learning algorithm to combine the clustering goal with the fairness objective to learn fair clusters adaptively. Experimental results on real-world datasets demonstrate that our model consistently outperforms state-of-the-art fair clustering algorithms. Our framework shows promising results for novel clustering tasks including flexible fairness constraints, multi-state PSVs and predictive clustering.


title: Mach limits in analytic spaces on exterior domains

abstract: We address the Mach limit problem for the Euler equations in an exterior domain with analytic boundary. We first prove the existence of tangential analytic vector fields for the exterior domain with constant analyticity radii, and introduce an analytic norm in which we distinguish derivatives taken from different directions. Then we prove the uniform boundedness of the solutions in the analytic space on a time interval independent of the Mach number, and Mach limit holds in the analytic norm. The results extends more generally to Gevrey initial data with convergence in a Gevrey norm.


title: OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outliers

abstract: Semi-supervised learning (SSL) is an effective means to leverage unlabeled data to improve a model's performance. Typical SSL methods like FixMatch assume that labeled and unlabeled data share the same label space. However, in practice, unlabeled data can contain categories unseen in the labeled set, i.e., outliers, which can significantly harm the performance of SSL algorithms. To address this problem, we propose a novel Open-set Semi-Supervised Learning (OSSL) approach called OpenMatch. Learning representations of inliers while rejecting outliers is essential for the success of OSSL. To this end, OpenMatch unifies FixMatch with novelty detection based on one-vs-all (OVA) classifiers. The OVA-classifier outputs the confidence score of a sample being an inlier, providing a threshold to detect outliers. Another key contribution is an open-set soft-consistency regularization loss, which enhances the smoothness of the OVA-classifier with respect to input transformations and greatly improves outlier detection. OpenMatch achieves state-of-the-art performance on three datasets, and even outperforms a fully supervised model in detecting outliers unseen in unlabeled data on CIFAR10.


title: Log2NS: Enhancing Deep Learning Based Analysis of Logs With Formal to Prevent Survivorship Bias

abstract: Analysis of large observational data sets generated by a reactive system is a common challenge in debugging system failures and determining their root cause. One of the major problems is that these observational data suffer from survivorship bias. Examples include analyzing traffic logs from networks, and simulation logs from circuit design. In such applications, users want to detect non-spurious correlations from observational data and obtain actionable insights about them. In this paper, we introduce log to Neuro-symbolic (Log2NS), a framework that combines probabilistic analysis from machine learning (ML) techniques on observational data with certainties derived from symbolic reasoning on an underlying formal model. We apply the proposed framework to network traffic debugging by employing the following steps. To detect patterns in network logs, we first generate global embedding vector representations of entities such as IP addresses, ports, and applications. Next, we represent large log flow entries as clusters that make it easier for the user to visualize and detect interesting scenarios that will be further analyzed. To generalize these patterns, Log2NS provides an ability to query from static logs and correlation engines for positive instances, as well as formal reasoning for negative and unseen instances. By combining the strengths of deep learning and symbolic methods, Log2NS provides a very powerful reasoning and debugging tool for log-based data. Empirical evaluations on a real internal data set demonstrate the capabilities of Log2NS.


title: Annotation Inconsistency and Entity Bias in MultiWOZ

abstract: MultiWOZ is one of the most popular multi-domain task-oriented dialog datasets, containing 10K+ annotated dialogs covering eight domains. It has been widely accepted as a benchmark for various dialog tasks, e.g., dialog state tracking (DST), natural language generation (NLG), and end-to-end (E2E) dialog modeling. In this work, we identify an overlooked issue with dialog state annotation inconsistencies in the dataset, where a slot type is tagged inconsistently across similar dialogs leading to confusion for DST modeling. We propose an automated correction for this issue, which is present in a whopping 70% of the dialogs. Additionally, we notice that there is significant entity bias in the dataset (e.g., "cambridge" appears in 50% of the destination cities in the train domain). The entity bias can potentially lead to named entity memorization in generative models, which may go unnoticed as the test set suffers from a similar entity bias as well. We release a new test set with all entities replaced with unseen entities. Finally, we benchmark joint goal accuracy (JGA) of the state-of-the-art DST baselines on these modified versions of the data. Our experiments show that the annotation inconsistency corrections lead to 7-10% improvement in JGA. On the other hand, we observe a 29% drop in JGA when models are evaluated on the new test set with unseen entities.


title: Approximate MRAM: High-performance and Power-efficient Computing with MRAM Chips for Error-tolerant Applications

abstract: Approximate computing (AC) leverages the inherent error resilience and is used in many big-data applications from various domains such as multimedia, computer vision, signal processing, and machine learning to improve systems performance and power consumption. Like many other approximate circuits and algorithms, the memory subsystem can also be used to enhance performance and save power significantly. This paper proposes an efficient and effective systematic methodology to construct an approximate non-volatile magneto-resistive RAM (MRAM) framework using consumer-off-the-shelf (COTS) MRAM chips. In the proposed scheme, an extensive experimental characterization of memory errors is performed by manipulating the write latency of MRAM chips which exploits the inherent (intrinsic/extrinsic process variation) stochastic switching behavior of magnetic tunnel junctions (MTJs). The experimental results and error-resilient image application reveal that the proposed AC framework provides a significant performance improvement and demonstrates a maximum reduction in MRAM write current of ~66% on average with negligible or no loss in output quality.


title: Radar Odometry Combining Probabilistic Estimation and Unsupervised Feature Learning

abstract: This paper presents a radar odometry method that combines probabilistic trajectory estimation and deep learned features without needing groundtruth pose information. The feature network is trained unsupervised, using only the on-board radar data. With its theoretical foundation based on a data likelihood objective, our method leverages a deep network for processing rich radar data, and a non-differentiable classic estimator for probabilistic inference. We provide extensive experimental results on both the publicly available Oxford Radar RobotCar Dataset and an additional 100 km of driving collected in an urban setting. Our sliding-window implementation of radar odometry outperforms most hand-crafted methods and approaches the current state of the art without requiring a groundtruth trajectory for training. We also demonstrate the effectiveness of radar odometry under adverse weather conditions. Code for this project can be found at: https://github.com/utiasASRL/hero_radar_odometry


title: Minimizing Oracle-Structured Composite Functions

abstract: We consider the problem of minimizing a composite convex function with two different access methods: an oracle, for which we can evaluate the value and gradient, and a structured function, which we access only by solving a convex optimization problem. We are motivated by two associated technological developments. For the oracle, systems like PyTorch or TensorFlow can automatically and efficiently compute gradients, given a computation graph description. For the structured function, systems like CVXPY accept a high level domain specific language description of the problem, and automatically translate it to a standard form for efficient solution. We develop a method that makes minimal assumptions about the two functions, does not require the tuning of algorithm parameters, and works well in practice across a variety of problems. Our algorithm combines a number of well-known ideas, including a low-rank quasi-Newton approximation of curvature, piecewise affine lower bounds from bundle-type methods, and two types of damping to ensure stability. We illustrate the method on stochastic optimization, utility maximization, and risk-averse programming problems, showing that our method is more efficient than standard solvers when the oracle function contains much data.


title: How the University Portal Inspired Changes in the Academic Assessment Culture

abstract: Information retrieval (IR) is known facilitator of changes ongoing in human society and vice versa. This is due to the fact that IR is a key component of the digital ecosystems, where both information providers and information consumers collaboratively address their problems with the use of technologies. Organization and design of such ecosystems drives particular social impact for all the players involved. In this paper, we study the impact made by a particular IR ecosystem (semantic portal) used for management of academic information resources and processes within the Ukrainian higher education. We show how this portal is changing a collective mindset of the academic community of its users. We argue that such impact becomes possible due to specific organization of the ecosystem, where all the information resources, IR services and related analytics (search, assessment, ranking, etc.) and IR users inhabit the same semantic space under umbrella of the corresponding ontologies. Personal values and preferences of the users configure on-the-fly the corresponding IR analytics and enable personalized value-driven IR services, making everyone feel involved into the organizational decision-making processes. Four years of active use of this portal in university environment has been reported and related impact is evaluated in this study.


title: An $\ell_p$ Variable Projection Method for Large-Scale Separable Nonlinear Inverse Problems

abstract: The variable projection (VarPro) method is an efficient method to solve separable nonlinear least squares problems. In this paper, we propose a modified VarPro for large-scale separable nonlinear inverse problems that promotes edge-preserving and sparsity properties on the desired solution and enhances the convergence of the parameters that define the forward problem. We adopt a majorization minimization method that relies on constructing a quadratic tangent majorant to approximate a general $\ell_p$ regularized problem by an $\ell_2$ regularized problem that can be solved by the aid of generalized Krylov subspace methods at a relatively low cost compared to the original unprojected problem. In addition, we can use more potential general regularizers including total variation (TV), framelet, and wavelets operators. The regularization parameter can be defined automatically at each iteration by means of generalized cross validation. Numerical examples on large-scale two-dimensional imaging problems arising from blind deconvolution are used to highlight the performance of the proposed approach in both quality of the reconstructed image as well as the reconstructed forward operator.


title: SMASH: Sparse Matrix Atomic Scratchpad Hashing

abstract: Sparse matrices, more specifically SpGEMM kernels, are commonly found in a wide range of applications, spanning graph-based path-finding to machine learning algorithms (e.g., neural networks). A particular challenge in implementing SpGEMM kernels has been the pressure placed on DRAM memory. One approach to tackle this problem is to use an inner product method for the SpGEMM kernel implementation. While the inner product produces fewer intermediate results, it can end up saturating the memory bandwidth, given the high number of redundant fetches of the input matrix elements. Using an outer product-based SpGEMM kernel can reduce redundant fetches, but at the cost of increased overhead due to extra computation and memory accesses for producing/managing partial products. In this thesis, we introduce a novel SpGEMM kernel implementation based on the row-wise product approach. We leverage atomic instructions to merge intermediate partial products as they are generated. The use of atomic instructions eliminates the need to create partial product matrices. To evaluate our row-wise product approach, we map an optimized SpGEMM kernel to a custom accelerator designed to accelerate graph-based applications. The targeted accelerator is an experimental system named PIUMA, being developed by Intel. PIUMA provides several attractive features, including fast context switching, user-configurable caches, globally addressable memory, non-coherent caches, and asynchronous pipelines. We tailor our SpGEMM kernel to exploit many of the features of the PIUMA fabric. This thesis compares our SpGEMM implementation against prior solutions, all mapped to the PIUMA framework. We briefly describe some of the PIUMA architecture features and then delve into the details of our optimized SpGEMM kernel. Our SpGEMM kernel can achieve 9.4x speedup as compared to competing approaches.


title: SMURF: Efficient and Scalable Metadata Access for Distributed Applications

abstract: In parallel with big data processing and analysis dominating the usage of distributed and cloud infrastructures, the demand for distributed metadata access and transfer has increased. In many application domains, the volume of data generated exceeds petabytes, while the corresponding metadata amounts to terabytes or even more. This paper proposes a novel solution for efficient and scalable metadata access for distributed applications across wide-area networks, dubbed SMURF. Our solution combines novel pipelining and concurrent transfer mechanisms with reliability, provides distributed continuum caching and prefetching strategies to sidestep fetching latency, and achieves scalable and high-performance metadata fetch/prefetch services in the cloud. We also study the phenomenon of semantic locality in real trace logs, which is not well utilized in metadata access prediction. We implement a novel prefetch predictor based on this observation and compare it with three existing state-of-the-art prefetch schemes on Yahoo! Hadoop audit traces. By effectively caching and prefetching metadata based on the access patterns, our continuum caching and prefetching mechanism significantly improves local cache hit rate and reduces the average fetching latency. We replayed approximately 20 Million metadata access operations from real audit traces, in which our system achieved 90% accuracy during prefetch prediction and reduced the average fetch latency by 50% compared to the state-of-the-art mechanisms.


title: SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentation

abstract: Temporal action segmentation is a task to classify each frame in the video with an action label. However, it is quite expensive to annotate every frame in a large corpus of videos to construct a comprehensive supervised training dataset. Thus in this work we propose an unsupervised method, namely SSCAP, that operates on a corpus of unlabeled videos and predicts a likely set of temporal segments across the videos. SSCAP leverages Self-Supervised learning to extract distinguishable features and then applies a novel Co-occurrence Action Parsing algorithm to not only capture the correlation among sub-actions underlying the structure of activities, but also estimate the temporal path of the sub-actions in an accurate and general way. We evaluate on both classic datasets (Breakfast, 50Salads) and the emerging fine-grained action dataset (FineGym) with more complex activity structures and similar sub-actions. Results show that SSCAP achieves state-of-the-art performance on all datasets and can even outperform some weakly-supervised approaches, demonstrating its effectiveness and generalizability.


title: Enhancing Environmental Enforcement with Near Real-Time Monitoring: Likelihood-Based Detection of Structural Expansion of Intensive Livestock Farms

abstract: Much environmental enforcement in the United States has historically relied on either self-reported data or physical, resource-intensive, infrequent inspections. Advances in remote sensing and computer vision, however, have the potential to augment compliance monitoring by detecting early warning signs of noncompliance. We demonstrate a process for rapid identification of significant structural expansion using Planet's 3m/pixel satellite imagery products and focusing on Concentrated Animal Feeding Operations (CAFOs) in the US as a test case. Unpermitted building expansion has been a particular challenge with CAFOs, which pose significant health and environmental risks. Using new hand-labeled dataset of 145,053 images of 1,513 CAFOs, we combine state-of-the-art building segmentation with a likelihood-based change-point detection model to provide a robust signal of building expansion (AUC = 0.86). A major advantage of this approach is that it can work with higher cadence (daily to weekly), but lower resolution (3m/pixel), satellite imagery than previously used in similar environmental settings. It is also highly generalizable and thus provides a near real-time monitoring tool to prioritize enforcement resources in other settings where unpermitted construction poses environmental risk, e.g. zoning, habitat modification, or wetland protection.


title: Time-Spatial Mode Selective Quantum Frequency Converter

abstract: We experimentally demonstrate a mode-selective quantum frequency converter over a compound spatio-temporal Hilbert space. We show that our method can achieve high-extinction for high-dimensional quantum state tomography by selectively upconverting the signal modes with a modulated and delayed pump. By preparing the pump in optimized modes through adaptive feedback control, selective frequency conversion is demonstrated with up to 30 dB extinction. The simultaneous operations over high-dimensional degrees of freedom in both spatial and temporal domains can serve as a viable resource for photon-efficient quantum communications and computation.


title: Detailed Primary and Secondary Distribution System Model Enhancement Using AMI Data

abstract: Reliable and accurate distribution system modeling, including the secondary network, is essential in examining distribution system performance with high penetration of distributed energy resources (DERs). This paper presents a highly automated, novel method to enhance the accuracy of utility distribution feeder models to capture their performance by matching simulation results with corresponding field measurements. The method is demonstrated using an actual feeder from an electrical utility with high penetration of DERs. The method proposed uses advanced metering infrastructure (AMI) voltage and derived active power measurements at the customer level, and data acquisition systems (DAS) measurements at the feeder-head, in conjunction with an AC optimal power flow (ACOPF) to estimate customer active and reactive power consumption over a time horizon, while accounting for unmetered loads. Additionally, the method proposed estimates both voltage magnitude and angle for each phase at the unbalanced distribution substation. Furthermore, the accuracy of the method developed is verified by comparing the time-series power flow results obtained from the enhancement algorithm with OpenDSS results. The proposed approach seamlessly manages the data available from the optimization procedure through the final model verification automatically.


title: EDDA: Explanation-driven Data Augmentation to Improve Explanation Faithfulness

abstract: Recent years have seen the introduction of a range of methods for post-hoc explainability of image classifier predictions. However, these post-hoc explanations may not always be faithful to classifier predictions, which poses a significant challenge when attempting to debug models based on such explanations. To this end, we seek a methodology that can improve the faithfulness of an explanation method with respect to model predictions which does not require ground truth explanations. We achieve this through a novel explanation-driven data augmentation (EDDA) technique that augments the training data with occlusions inferred from model explanations; this is based on the simple motivating principle that \emph{if} the explainer is faithful to the model \emph{then} occluding salient regions for the model prediction should decrease the model confidence in the prediction, while occluding non-salient regions should not change the prediction. To verify that the proposed augmentation method has the potential to improve faithfulness, we evaluate EDDA using a variety of datasets and classification models. We demonstrate empirically that our approach leads to a significant increase of faithfulness, which can facilitate better debugging and successful deployment of image classification models in real-world applications.


title: The query complexity of sampling from strongly log-concave distributions in one dimension

abstract: We establish the first tight lower bound of $\Omega(\log\log\kappa)$ on the query complexity of sampling from the class of strongly log-concave and log-smooth distributions with condition number $\kappa$ in one dimension. Whereas existing guarantees for MCMC-based algorithms scale polynomially in $\kappa$, we introduce a novel algorithm based on rejection sampling that closes this doubly exponential gap.


title: A Joint Intensity-Neuromorphic Event Imaging System for Resource Constrained Devices

abstract: We present a novel adaptive multi-modal intensity-event algorithm to optimize an overall objective of object tracking under bit rate constraints for a host-chip architecture. The chip is a computationally resource constrained device acquiring high resolution intensity frames and events, while the host is capable of performing computationally expensive tasks. We develop a joint intensity-neuromorphic event rate-distortion compression framework with a quadtree (QT) based compression of intensity and events scheme. The data acquisition on the chip is driven by the presence of objects of interest in the scene as detected by an object detector. The most informative intensity and event data are communicated to the host under rate constraints, so that the best possible tracking performance is obtained. The detection and tracking of objects in the scene are done on the distorted data at the host. Intensity and events are jointly used in a fusion framework to enhance the quality of the distorted images, so as to improve the object detection and tracking performance. The performance assessment of the overall system is done in terms of the multiple object tracking accuracy (MOTA) score. Compared to using intensity modality only, there is an improvement in MOTA using both these modalities in different scenarios.


title: Hybrid density functional study of band gap engineering of SrTiO3 photocatalyst via doping for water splitting

abstract: Perovskite SrTiO3 (STO) is an attractive photocatalyst for solar water splitting, but suffers from a limited photoresponse in the ultraviolet spectral range due to its wide band gap. By means of hybrid density functional theory calculations, we systematically study engineering its band gap via doping 4d and 5d transition metals M (M=Zr, Nb, Mo, Tc, Ru, Rh, Pd, Hf, Ta, W, Re, Os, Ir and Pt) and chalcogen elements Y (Y=S and Se). We find that transition metal dopant M either has no effect on STO band gap or introduces detrimental mid-gap states, except for Pd and Pt that are able to reduce the STO band gap. In contrast, doping S and Se significantly reduces STO's direct band gap, thus leading to appreciable optical absorption transitions in the visible spectral range. Our findings provide that Pd, S and Se doped STO are potential promising photocatalysts for water splitting under visible light irradiation, thereby providing insightful theoretical guides for experiments to improve the photocatalytic activity of STO.


title: Rejection sampling from shape-constrained distributions in sublinear time

abstract: We consider the task of generating exact samples from a target distribution, known up to normalization, over a finite alphabet. The classical algorithm for this task is rejection sampling, and although it has been used in practice for decades, there is surprisingly little study of its fundamental limitations. In this work, we study the query complexity of rejection sampling in a minimax framework for various classes of discrete distributions. Our results provide new algorithms for sampling whose complexity scales sublinearly with the alphabet size. When applied to adversarial bandits, we show that a slight modification of the Exp3 algorithm reduces the per-iteration complexity from $\mathcal O(K)$ to $\mathcal O(\log^2 K)$, where $K$ is the number of arms.


title: NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoning

abstract: Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have their advantages and weaknesses. However, currently, no method combines them in a system to solve the task of NLI. To merge symbolic and deep learning methods, we propose an inference framework called NeuralLog, which utilizes both a monotonicity-based logical inference engine and a neural network language model for phrase alignment. Our framework models the NLI task as a classic search problem and uses the beam search algorithm to search for optimal inference paths. Experiments show that our joint logic and neural inference system improves accuracy on the NLI task and can achieve state-of-art accuracy on the SICK and MED datasets.


title: Trotter product formulae for $*$-automorphisms of quantum lattice systems

abstract: We consider the dynamics $t\mapsto\tau_t$ of an infinite quantum lattice system that is generated by a local interaction. If the interaction decomposes into a finite number of terms that are themselves local interactions, we show that $\tau_t$ can be efficiently approximated by a product of $n$ automorphisms, each of them being an alternating product generated by the individual terms. For any integer $m$, we construct a product formula (in the spirit of Trotter) such that the approximation error scales as $n^{-m}$. Our bounds hold in norm, pointwise for algebra elements that are sufficiently well approximated by finite volume observables.


title: Weak Bruhat interval modules of the 0-Hecke algebra

abstract: The purpose of this paper is to provide a unified method for dealing with various 0-Hecke modules constructed using tableaux so far. To do this, we assign a $0$-Hecke module to each left weak Bruhat interval, called a weak Bruhat interval module. We prove that every indecomposable summand of the $0$-Hecke modules categorifying dual immaculate quasisymmetric functions, extended Schur functions, quasisymmetric Schur functions, and Young row-strict quasisymmetric Schur functions is a weak Bruhat interval module. We further study embedding into the regular representation, induction product, restriction, and (anti-)involution twists of weak Bruhat interval modules.


title: Towards a Rigorous Statistical Analysis of Empirical Password Datasets

abstract: A central challenge in password security is to characterize the attacker's guessing curve i.e., what is the probability that the attacker will crack a random user's password within the first $G$ guesses. A key challenge is that the guessing curve depends on the attacker's guessing strategy and the distribution of user passwords both of which are unknown to us. In this work we aim to follow Kerckhoffs' principle and analyze the performance of an optimal attacker who knows the password distribution. Let $\lambda_G$ denote the probability that such an attacker can crack a random user's password within $G$ guesses. We develop several statistically rigorous techniques to upper and lower bound $\lambda_G$ given $N$ independent samples from the unknown distribution. We show that our bounds hold with high confidence and apply our techniques to analyze eight password datasets. Our empirical analysis shows that even state-of-the-art password cracking models are often significantly less guess efficient than an attacker who can optimize its attack based on its (partial) knowledge of the password distribution. We also apply our techniques to re-examine the empirical password distribution and Zipf's Law. We find that the empirical distribution closely matches our bounds on $\lambda_G$ when $G$ is not too large i.e., $G \ll N$. However, for larger values of $G$ our empirical analysis rigorously demonstrates that the empirical distribution (resp. Zipf's Law) overestimates the attacker's success rate. We apply our techniques to upper/lower bound the effectiveness of password throttling mechanisms (key-stretching) which are used to reduce the number of attacker guesses $G$. Finally, if we make an additional assumption about the way users respond to password restrictions, we can use our techniques to evaluate the effectiveness of password composition policies which restrict the passwords users may select.


title: The Definitions of Interpretability and Learning of Interpretable Models

abstract: As machine learning algorithms getting adopted in an ever-increasing number of applications, interpretation has emerged as a crucial desideratum. In this paper, we propose a mathematical definition for the human-interpretable model. In particular, we define interpretability between two information process systems. If a prediction model is interpretable by a human recognition system based on the above interpretability definition, the prediction model is defined as a completely human-interpretable model. We further design a practical framework to train a completely human-interpretable model by user interactions. Experiments on image datasets show the advantages of our proposed model in two aspects: 1) The completely human-interpretable model can provide an entire decision-making process that is human-understandable; 2) The completely human-interpretable model is more robust against adversarial attacks.


title: A Stochastic Alternating Balance $k$-Means Algorithm for Fair Clustering

abstract: In the application of data clustering to human-centric decision-making systems, such as loan applications and advertisement recommendations, the clustering outcome might discriminate against people across different demographic groups, leading to unfairness. A natural conflict occurs between the cost of clustering (in terms of distance to cluster centers) and the balance representation of all demographic groups across the clusters, leading to a bi-objective optimization problem that is nonconvex and nonsmooth. To determine the complete trade-off between these two competing goals, we design a novel stochastic alternating balance fair $k$-means (SAfairKM) algorithm, which consists of alternating classical mini-batch $k$-means updates and group swap updates. The number of $k$-means updates and the number of swap updates essentially parameterize the weight put on optimizing each objective function. Our numerical experiments show that the proposed SAfairKM algorithm is robust and computationally efficient in constructing well-spread and high-quality Pareto fronts both on synthetic and real datasets.


title: FoveaTer: Foveated Transformer for Image Classification

abstract: Many animals and humans process the visual field with a varying spatial resolution (foveated vision) and use peripheral processing to make eye movements and point the fovea to acquire high-resolution information about objects of interest. This architecture results in computationally efficient rapid scene exploration. Recent progress in self-attention-based Vision Transformers, an alternative to the traditionally convolution-reliant computer vision systems. However, the Transformer models do not explicitly model the foveated properties of the visual system nor the interaction between eye movements and the classification task. We propose Foveated Transformer (FoveaTer) model, which uses pooling regions and eye movements to perform object classification tasks using a Vision Transformer architecture. Using square pooling regions or biologically-inspired radial-polar pooling regions, our proposed model pools the image features from the convolution backbone and uses the pooled features as an input to transformer layers. It decides on subsequent fixation location based on the attention assigned by the Transformer to various locations from past and present fixations. It dynamically allocates more fixation/computational resources to more challenging images before making the final image category decision. Using five ablation studies, we evaluate the contribution of different components of the Foveated model. We perform a psychophysics scene categorization task and use the experimental data to find a suitable radial-polar pooling region combination. We also show that the Foveated model better explains the human decisions in a scene categorization task than a Baseline model. We demonstrate our model's robustness against PGD adversarial attacks with both types of pooling regions, where we see the Foveated model outperform the Baseline model.


title: Multi-Label Few-Shot Learning for Aspect Category Detection

abstract: Aspect category detection (ACD) in sentiment analysis aims to identify the aspect categories mentioned in a sentence. In this paper, we formulate ACD in the few-shot learning scenario. However, existing few-shot learning approaches mainly focus on single-label predictions. These methods can not work well for the ACD task since a sentence may contain multiple aspect categories. Therefore, we propose a multi-label few-shot learning method based on the prototypical network. To alleviate the noise, we design two effective attention mechanisms. The support-set attention aims to extract better prototypes by removing irrelevant aspects. The query-set attention computes multiple prototype-specific representations for each query instance, which are then used to compute accurate distances with the corresponding prototypes. To achieve multi-label inference, we further learn a dynamic threshold per instance by a policy network. Extensive experimental results on three datasets demonstrate that the proposed method significantly outperforms strong baselines.


title: Traversing double-well potential energy surfaces: photoinduced concurrent intralayer and interlayer structural transitions in XTe2 (X=Mo, W)

abstract: Manipulating crystal structure and the corresponding electronic properties in quantum materials provides opportunities for the exploration of exotic physics and practical applications. Here, by ultrafast electron diffraction, structure factor calculation and TDDFT-MD simulations, we report the photoinduced concurrent intralayer and interlayer structural transitions in the Td and 1T' phase of XTe2 (X=Mo, W). Concomitant with the interlayer structural transition by shear displacement, the ultrafast suppression of the intralayer Peierls distortion within 0.3 ps is demonstrated and attributed to Mo-Mo (W-W) bond stretching. We discuss the modification of multiple quantum electronic states associated with the intralayer and interlayer structural transitions, such as the topological band inversion and the higher-order topological state. The twin structure and the stacking fault in XTe2 are identified by the ultrafast structural response. Our work elucidates the pathway of the photoinduced intralayer and interlayer structural transitions in atomic and femtosecond spatiotemporal scale. Moreover, the concurrent intralayer and interlayer structural transitions reveals the traversal of all double-well potential energy surfaces (DWPES) by laser excitation in material system, which may be an intrinsic mechanism in the field of photoexcitation-driven symmetry engineering, beyond the single DWPES transition model and the order-disorder transition model.


title: Local Minimizers of the Crouzeix Ratio: A Nonsmooth Optimization Case Study

abstract: Given a square matrix $A$ and a polynomial $p$, the Crouzeix ratio is the norm of the polynomial on the field of values of $A$ divided by the 2-norm of the matrix $p(A)$. Crouzeix's conjecture states that the globally minimal value of the Crouzeix ratio is 0.5, regardless of the matrix order and polynomial degree, and it is known that 1 is a frequently occurring locally minimal value. Making use of a heavy-tailed distribution to initialize our optimization computations, we demonstrate for the first time that the Crouzeix ratio has many other locally minimal values between 0.5 and 1. Besides showing that the same function values are repeatedly obtained for many different starting points, we also verify that an approximate nonsmooth stationarity condition holds at computed candidate local minimizers. We also find that the same locally minimal values are often obtained both when optimizing over real matrices and polynomials, and over complex matrices and polynomials. We argue that minimization of the Crouzeix ratio makes a very interesting nonsmooth optimization case study, illustrating among other things how effective the BFGS method is for nonsmooth, nonconvex optimization. Our method for verifying approximate nonsmooth stationarity is based on what may be a novel approach to finding approximate subgradients of max functions on an interval. Our extensive computations strongly support Crouzeix's conjecture: in all cases, we find that the smallest locally minimal value is 0.5.


title: The Jacobi sums over Galois rings of arbitrary characters and their applications in constructing asymptotically optimal codebooks

abstract: Codebooks with small maximum cross-correlation amplitudes are used to distinguish the signals from different users in CDMA communication systems. In this paper, we first study the Jacobi sums over Galois rings of arbitrary characteristics and completely determine their absolute values, which extends the work in [34], where the Jacobi sums over Galois rings with characteristics of a square of a prime number were discussed. Then, the deterministic construction of codebooks based on the Jacobi sums over Galois rings of arbitrary characteristics is presented, which produces asymptotically optimal codebooks with respect to the Welch bound. In addition, the parameters of the codebooks provided in this paper are new.


title: The isoscalar monopole strength of 13C

abstract: To identify the 3alpha BEC state with the excess neutron, we have investigated the monopole strength of the excited states of 13C by using the theoretical framework of the real-time evolution method. The calculations have revealed several candidates of the Hoyle-analog states in a highly excited region.


title: Investigating the Significance of Bellwether Effect to Improve Software Effort Estimation

abstract: Bellwether effect refers to the existence of exemplary projects (called the Bellwether) within a historical dataset to be used for improved prediction performance. Recent studies have shown an implicit assumption of using recently completed projects (referred to as moving window) for improved prediction accuracy. In this paper, we investigate the Bellwether effect on software effort estimation accuracy using moving windows. The existence of the Bellwether was empirically proven based on six postulations. We apply statistical stratification and Markov chain methodology to select the Bellwether moving window. The resulting Bellwether moving window is used to predict the software effort of a new project. Empirical results show that Bellwether effect exist in chronological datasets with a set of exemplary and recently completed projects representing the Bellwether moving window. Result from this study has shown that the use of Bellwether moving window with the Gaussian weighting function significantly improve the prediction accuracy.


title: DPLM: A Deep Perceptual Spatial-Audio Localization Metric

abstract: Subjective evaluations are critical for assessing the perceptual realism of sounds in audio-synthesis driven technologies like augmented and virtual reality. However, they are challenging to set up, fatiguing for users, and expensive. In this work, we tackle the problem of capturing the perceptual characteristics of localizing sounds. Specifically, we propose a framework for building a general purpose quality metric to assess spatial localization differences between two binaural recordings. We model localization similarity by utilizing activation-level distances from deep networks trained for direction of arrival (DOA) estimation. Our proposed metric (DPLM) outperforms baseline metrics on correlation with subjective ratings on a diverse set of datasets, even without the benefit of any human-labeled training data.


title: Primes in the Chebotarev density theorem for all number fields

abstract: We establish an explicit bound for the least prime occurring in the Chebotarev density theorem without any restriction. Let $L/K$ be any Galois extension of number fields such that $L\not=\mathbb{Q}$, and let $C$ be a conjugacy class in the Galois group of $L/K$. We show that there exists an unramified prime $\mathfrak{p}$ of $K$ such that $\sigma_{\mathfrak{p}}=C$ and $N \mathfrak{p} \le d_{L}^{B}$ with $B= 310$. This improves the value $B=12\,577$ as proven by Ahn and Kwon. In comparison to previous works on the subject, we modify the weights to detect the least prime, and we use a new version of Tur\'an's power sum method which gives a stronger Deuring-Heilbronn (zero-repulsion) phenomenon. In addition, we refine the analysis of how the location of the potential exceptional zero for $\zeta_L(s)$ affects the final result. We also use Fiori's numerical verification for $L$ up to a certain discriminant height. Finally, we provide a lower bound for the number of unramified primes $\mathfrak{p}$ of $K$ such that $\sigma_{\mathfrak{p}}=C$.


title: Quantum algorithm for calculation of transition amplitudes in hybrid tensor networks

abstract: The hybrid tensor network approach allows us to perform calculations on systems larger than the scale of a quantum computer. However, when calculating transition amplitudes, there is a problem that the number of terms to be measured increases exponentially with that of contracted operators. The problem is caused by the fact that the contracted operators are represented as non-Hermitian operators. In this study, we propose a method for the hybrid tensor network calculation that contracts non-Hermitian operators without the exponential increase of the number of terms. In the proposed method, calculations of transition amplitudes are performed by combining the singular value decomposition of the contracted non-Hermitian operators with the Hadamard test. The method significantly extends the applicability of the hybrid tensor network approach.


title: Verified Quadratic Virtual Substitution for Real Arithmetic

abstract: This paper presents a formally verified quantifier elimination (QE) algorithm for first-order real arithmetic by linear and quadratic virtual substitution (VS) in Isabelle/HOL. The Tarski-Seidenberg theorem established that the first-order logic of real arithmetic is decidable by QE. However, in practice, QE algorithms are highly complicated and often combine multiple methods for performance. VS is a practically successful method for QE that targets formulas with low-degree polynomials. To our knowledge, this is the first work to formalize VS for quadratic real arithmetic including inequalities. The proofs necessitate various contributions to the existing multivariate polynomial libraries in Isabelle/HOL. Our framework is modularized and easily expandable (to facilitate integrating future optimizations), and could serve as a basis for developing practical general-purpose QE algorithms. Further, as our formalization is designed with practicality in mind, we export our development to SML and test the resulting code on 378 benchmarks from the literature, comparing to Redlog, Z3, Wolfram Engine, and SMT-RAT. This identified inconsistencies in some tools, underscoring the significance of a verified approach for the intricacies of real arithmetic.


title: E2ETag: An End-to-End Trainable Method for Generating and Detecting Fiducial Markers

abstract: Existing fiducial markers solutions are designed for efficient detection and decoding, however, their ability to stand out in natural environments is difficult to infer from relatively limited analysis. Furthermore, worsening performance in challenging image capture scenarios - such as poor exposure, motion blur, and off-axis viewing - sheds light on their limitations. E2ETag introduces an end-to-end trainable method for designing fiducial markers and a complimentary detector. By introducing back-propagatable marker augmentation and superimposition into training, the method learns to generate markers that can be detected and classified in challenging real-world environments using a fully convolutional detector network. Results demonstrate that E2ETag outperforms existing methods in ideal conditions and performs much better in the presence of motion blur, contrast fluctuations, noise, and off-axis viewing angles. Source code and trained models are available at https://github.com/jbpeace/E2ETag.


title: FCPose: Fully Convolutional Multi-Person Pose Estimation with Dynamic Instance-Aware Convolutions

abstract: We propose a fully convolutional multi-person pose estimation framework using dynamic instance-aware convolutions, termed FCPose. Different from existing methods, which often require ROI (Region of Interest) operations and/or grouping post-processing, FCPose eliminates the ROIs and grouping post-processing with dynamic instance-aware keypoint estimation heads. The dynamic keypoint heads are conditioned on each instance (person), and can encode the instance concept in the dynamically-generated weights of their filters. Moreover, with the strong representation capacity of dynamic convolutions, the keypoint heads in FCPose are designed to be very compact, resulting in fast inference and making FCPose have almost constant inference time regardless of the number of persons in the image. For example, on the COCO dataset, a real-time version of FCPose using the DLA-34 backbone infers about 4.5x faster than Mask R-CNN (ResNet-101) (41.67 FPS vs. 9.26FPS) while achieving improved performance. FCPose also offers better speed/accuracy trade-off than other state-of-the-art methods. Our experiment results show that FCPose is a simple yet effective multi-person pose estimation framework. Code is available at: https://git.io/AdelaiDet


title: Improved, Extended, and Total Impact Factor of a Journal

abstract: In this short paper we recall the (Garfield) Impact Factor of a Journal, we improve and extend it, and eventually we present the Total Impact Factor that reflects the most accurate impact factor.


title: Prediction error quantification through probabilistic scaling -- EXTENDED VERSION

abstract: In this paper, we address the probabilistic error quantification of a general class of prediction methods. We consider a given prediction model and show how to obtain, through a sample-based approach, a probabilistic upper bound on the absolute value of the prediction error. The proposed scheme is based on a probabilistic scaling methodology in which the number of required randomized samples is independent of the complexity of the prediction model. The methodology is extended to address the case in which the probabilistic uncertain quantification is required to be valid for every member of a finite family of predictors. We illustrate the results of the paper by means of a numerical example.


title: We Know What You Want: An Advertising Strategy Recommender System for Online Advertising

abstract: Advertising expenditures have become the major source of revenue for e-commerce platforms. Providing good advertising experiences for advertisers by reducing their costs of trial and error in discovering the optimal advertising strategies is crucial for the long-term prosperity of online advertising. To achieve this goal, the advertising platform needs to identify the advertiser's optimization objectives, and then recommend the corresponding strategies to fulfill the objectives. In this work, we first deploy a prototype of strategy recommender system on Taobao display advertising platform, which indeed increases the advertisers' performance and the platform's revenue, indicating the effectiveness of strategy recommendation for online advertising. We further augment this prototype system by explicitly learning the advertisers' preferences over various advertising performance indicators and then optimization objectives through their adoptions of different recommending advertising strategies. We use contextual bandit algorithms to efficiently learn the advertisers' preferences and maximize the recommendation adoption, simultaneously. Simulation experiments based on Taobao online bidding data show that the designed algorithms can effectively optimize the strategy adoption rate of advertisers.


title: Quotation Recommendation and Interpretation Based on Transformation from Queries to Quotations

abstract: To help individuals express themselves better, quotation recommendation is receiving growing attention. Nevertheless, most prior efforts focus on modeling quotations and queries separately and ignore the relationship between the quotations and the queries. In this work, we introduce a transformation matrix that directly maps the query representations to quotation representations. To better learn the mapping relationship, we employ a mapping loss that minimizes the distance of two semantic spaces (one for quotation and another for mapped-query). Furthermore, we explore using the words in history queries to interpret the figurative language of quotations, where quotation-aware attention is applied on top of history queries to highlight the indicator words. Experiments on two datasets in English and Chinese show that our model outperforms previous state-of-the-art models.


title: RaspberryPI for mosquito neutralization by power laser

abstract: In this article for the first time, comprehensive studies of mosquito neutralization using machine vision and a 1 W power laser are considered. Developed laser installation with Raspberry Pi that changing the direction of the laser with a galvanometer. We developed a program for mosquito tracking in real. The possibility of using deep neural networks, Haar cascades, machine learning for mosquito recognition was considered. We considered in detail the classification problems of mosquitoes in images. A recommendation is given for the implementation of this device based on a microcontroller for subsequent use as part of an unmanned aerial vehicle. Any harmful insects in the fields can be used as objects for control.


title: Instance Segmentation of Microscopic Foraminifera

abstract: Foraminifera are single-celled marine organisms that construct shells that remain as fossils in the marine sediments. Classifying and counting these fossils are important in e.g. paleo-oceanographic and -climatological research. However, the identification and counting process has been performed manually since the 1800s and is laborious and time-consuming. In this work, we present a deep learning-based instance segmentation model for classifying, detecting, and segmenting microscopic foraminifera. Our model is based on the Mask R-CNN architecture, using model weight parameters that have learned on the COCO detection dataset. We use a fine-tuning approach to adapt the parameters on a novel object detection dataset of more than 7000 microscopic foraminifera and sediment grains. The model achieves a (COCO-style) average precision of $0.78 \pm 0.00$ on the classification and detection task, and $0.80 \pm 0.00$ on the segmentation task. When the model is evaluated without challenging sediment grain images, the average precision for both tasks increases to $0.84 \pm 0.00$ and $0.86 \pm 0.00$, respectively. Prediction results are analyzed both quantitatively and qualitatively and discussed. Based on our findings we propose several directions for future work, and conclude that our proposed model is an important step towards automating the identification and counting of microscopic foraminifera.


title: Evolving Deep Convolutional Neural Network by Hybrid Sine-Cosine and Extreme Learning Machine for Real-time COVID19 Diagnosis from X-Ray Images

abstract: The COVID19 pandemic globally and significantly has affected the life and health of many communities. The early detection of infected patients is effective in fighting COVID19. Using radiology (X-Ray) images is perhaps the fastest way to diagnose the patients. Thereby, deep Convolutional Neural Networks (CNNs) can be considered as applicable tools to diagnose COVID19 positive cases. Due to the complicated architecture of a deep CNN, its real-time training and testing become a challenging problem. This paper proposes using the Extreme Learning Machine (ELM) instead of the last fully connected layer to address this deficiency. However, the parameters' stochastic tuning of ELM's supervised section causes the final model unreliability. Therefore, to cope with this problem and maintain network reliability, the sine-cosine algorithm was utilized to tune the ELM's parameters. The designed network is then benchmarked on the COVID-Xray-5k dataset, and the results are verified by a comparative study with canonical deep CNN, ELM optimized by cuckoo search, ELM optimized by genetic algorithm, and ELM optimized by whale optimization algorithm. The proposed approach outperforms comparative benchmarks with a final accuracy of 98.83% on the COVID-Xray-5k dataset, leading to a relative error reduction of 2.33% compared to a canonical deep CNN. Even more critical, the designed network's training time is only 0.9421 milliseconds and the overall detection test time for 3100 images is 2.721 seconds.


title: Characterization of the probability and information entropy of a process with an exponentially increasing sample space and its application to the Broad Money Supply

abstract: There is a random variable (X) with a determined outcome (i.e., X = x0), p(x0) = 1. Consider x0 to have a discrete uniform distribution over the integer interval [1, s], where the size of the sample space (s) = 1, in the initial state, such that p(x0) = 1. What is the probability of x0 and the associated information entropy (H), as s increases exponentially? If the sample space expansion occurs at an exponential rate (rate constant = lambda) with time (t) and applying time scaling, such that T = lambda x t, gives: p(x0|T)=exp(-T) and H(T)=T. The characterization has also been extended to include exponential expansion by means of simultaneous, independent processes, as well as the more general multi-exponential case. The methodology was applied to the expansion of the broad money supply of US$ over the period 2001-2019, as a real-world example. At any given time, the information entropy is related to the rate at which the sample space is expanding. In the context of the expansion of the broad money supply, the information entropy could be considered to be related to the "velocity" of the expansion of the money supply.


title: Constraint-Based Inference of Heuristics for Foreign Exchange Trade Model Optimization

abstract: The Foreign Exchange (Forex) is a large decentralized market, on which trading analysis and algorithmic trading are popular. Research efforts have been focusing on proof of efficiency of certain technical indicators. We demonstrate, however, that the values of indicator functions are not reproducible and often reduce the number of trade opportunities, compared to price-action trading. In this work, we develop two dataset-agnostic Forex trading heuristic templates with high rate of trading signals. In order to determine most optimal parameters for the given heuristic prototypes, we perform a machine learning simulation of 10 years of Forex price data over three low-margin instruments and 6 different OHLC granularities. As a result, we develop a specific and reproducible list of most optimal trade parameters found for each instrument-granularity pair, with 118 pips of average daily profit for the optimized configuration.


title: A Survey of Performance Optimization in Neural Network-Based Video Analytics Systems

abstract: Video analytics systems perform automatic events, movements, and actions recognition in a video and make it possible to execute queries on the video. As a result of a large number of video data that need to be processed, optimizing the performance of video analytics systems has become an important research topic. Neural networks are the state-of-the-art for performing video analytics tasks such as video annotation and object detection. Prior survey papers consider application-specific video analytics techniques that improve accuracy of the results; however, in this survey paper, we provide a review of the techniques that focus on optimizing the performance of Neural Network-Based Video Analytics Systems.


title: Classifying States of Cooking Objects Using Convolutional Neural Network

abstract: Automated cooking machine is a goal for the future. The main aim is to make the cooking process easier, safer, and create human welfare. To allow robots to accurately perform the cooking activities, it is important for them to understand the cooking environment and recognize the objects, especially correctly identifying the state of the cooking objects. This will significantly improve the correctness of the following cooking recipes. In this project, several parts of the experiment were conducted to design a robust deep convolutional neural network for classifying the state of the cooking objects from scratch. The model is evaluated by using various techniques, such as adjusting architecture layers, tuning key hyperparameters, and using different optimization techniques to maximize the accuracy of state classification.


title: The Impact of the U.S. Census Disclosure Avoidance System on Redistricting and Voting Rights Analysis

abstract: The US Census Bureau plans to protect the privacy of 2020 Census respondents through its Disclosure Avoidance System (DAS), which attempts to achieve differential privacy guarantees by adding noise to the Census microdata. By applying redistricting simulation and analysis methods to DAS-protected 2010 Census data, we find that the protected data are not of sufficient quality for redistricting purposes. We demonstrate that the injected noise makes it impossible for states to accurately comply with the One Person, One Vote principle. Our analysis finds that the DAS-protected data are biased against certain areas, depending on voter turnout and partisan and racial composition, and that these biases lead to large and unpredictable errors in the analysis of partisan and racial gerrymanders. Finally, we show that the DAS algorithm does not universally protect respondent privacy. Based on the names and addresses of registered voters, we are able to predict their race as accurately using the DAS-protected data as when using the 2010 Census data. Despite this, the DAS-protected data can still inaccurately estimate the number of majority-minority districts. We conclude with recommendations for how the Census Bureau should proceed with privacy protection for the 2020 Census.


title: Comprehensive Analysis On Determinants Of Bank Profitability In Bangladesh

abstract: The study investigates the relationship between bank profitability and a comprehensive list of bank specific, industry specific and macroeconomic variables using unique panel data from 23 Bangladeshi banks with large market shares from 2005 to 2019 employing the Pooled Ordinary Least Square (POLS) Method for regression estimation. The random Effect model has been used to check for robustness. Three variables, namely, Return on Asset (ROA), Return on Equity (ROE), and Net Interest Margin (NIM), have been used as profitability proxies. Non-interest income, capital ratio, and GDP growth have been found to have a significant relationship with ROA. In addition to non-interest income, market share, bank size, and real exchange rates are significant explaining variables if profitability is measured as NIM. The only significant determinant of profitability measured by ROE is market share. The primary contribution of this study to the existing knowledge base is an extensive empirical analysis by covering the entire gamut of independent variables (bank specific, industry related, and macroeconomic) to explain the profitability of the banks in Bangladesh. It also covers an extensive and recent data set. Banking sector stakeholders may find great value from the outputs of this paper. Regulators and policymakers may find this useful in undertaking analyses in setting policy rates, banking industry stability, and impact assessment of critical policy measures before and after the enactment, etc. Investors and the bank management are to use the findings of this paper in analyzing the real drivers of profitability of the banks they are contemplating to invest and managing on a daily basis.


title: Impact of Public and Private Investments on Economic Growth of Developing Countries

abstract: This paper aims to study the impact of public and private investments on the economic growth of developing countries. The study uses the panel data of 39 developing countries covering the periods 1990-2019. The study was based on the neoclassical growth models or exogenous growth models state in which land, labor, capital accumulation, etc., and technology proved substantial for economic growth. The paper finds that public investment has a strong positive impact on economic growth than private investment. Gross capital formation, labor growth, and government final consumption expenditure were found significant in explaining the economic growth. Overall, both public and private investments are substantial for the economic growth and development of developing countries.


title: Norm of the discrete Ces\`aro operator minus identity

abstract: The norm of $C-I$ on $\ell^p$, where $C$ is the Ces\`aro operator, is shown to be $1/(p-1)$ when $1<p\le2$. This verifies a recent conjecture of G. J. O. Jameson. The norm of $C-I$ on $\ell^p$ is also determined when $2< p<\infty$. The two parts together answer a question raised by G. Bennett in 1996. Operator norms in the continuous case, Hardy's averaging operator minus identity, are already known. Norms in the discrete and continuous cases coincide.


title: CNTLS: A Benchmark Dataset for Abstractive or Extractive Chinese Timeline Summarization

abstract: Timeline summarization (TLS) involves creating summaries of long-running events using dated summaries from numerous news articles. However, limited data availability has significantly slowed down the development of timeline summarization. In this paper, we introduce the CNTLS dataset, a versatile resource for Chinese timeline summarization. CNTLS encompasses 77 real-life topics, each with 2524 documents and summarizes nearly 60\% days duration compression on average all topics. We meticulously analyze the corpus using well-known metrics, focusing on the style of the summaries and the complexity of the summarization task. Specifically, we evaluate the performance of various extractive and generative summarization systems on the CNTLS corpus to provide benchmarks and support further research. To the best of our knowledge, CNTLS is the first Chinese timeline summarization dataset. The dataset and source code are released\footnote{Code and data available at: \emph{\url{https://github.com/OpenSUM/CNTLS}}.}.


title: Universal Adder Neural Networks

abstract: Compared with cheap addition operation, multiplication operation is of much higher computation complexity. The widely-used convolutions in deep neural networks are exactly cross-correlation to measure the similarity between input feature and convolution filters, which involves massive multiplications between float values. In this paper, we present adder networks (AdderNets) to trade these massive multiplications in deep neural networks, especially convolutional neural networks (CNNs), for much cheaper additions to reduce computation costs. In AdderNets, we take the $\ell_1$-norm distance between filters and input feature as the output response. We first develop a theoretical foundation for AdderNets, by showing that both the single hidden layer AdderNet and the width-bounded deep AdderNet with ReLU activation functions are universal function approximators. An approximation bound for AdderNets with a single hidden layer is also presented. We further analyze the influence of this new similarity measure on the optimization of neural network and develop a special training scheme for AdderNets. Based on the gradient magnitude, an adaptive learning rate strategy is proposed to enhance the training procedure of AdderNets. AdderNets can achieve a 75.7% Top-1 accuracy and a 92.3% Top-5 accuracy using ResNet-50 on the ImageNet dataset without any multiplication in the convolutional layer.


title: Understanding Instance-based Interpretability of Variational Auto-Encoders

abstract: Instance-based interpretation methods have been widely studied for supervised learning methods as they help explain how black box neural networks predict. However, instance-based interpretations remain ill-understood in the context of unsupervised learning. In this paper, we investigate influence functions [Koh and Liang, 2017], a popular instance-based interpretation method, for a class of deep generative models called variational auto-encoders (VAE). We formally frame the counter-factual question answered by influence functions in this setting, and through theoretical analysis, examine what they reveal about the impact of training samples on classical unsupervised learning methods. We then introduce VAE- TracIn, a computationally efficient and theoretically sound solution based on Pruthi et al. [2020], for VAEs. Finally, we evaluate VAE-TracIn on several real world datasets with extensive quantitative and qualitative analysis.


title: Multiplicity Scaling of Light Nuclei Production in Relativistic Heavy-Ion Collisions

abstract: Using the nucleon coalescence model based on kinetic freeze-out nucleons from the 3D MUSIC+UrQMD and the 2D VISHNU hybrid model with a crossover equation of state, we study the multiplicity dependence of deuteron ($d$) and triton ($t$) production from central to peripheral Au+Au collisions at $\sqrt{s_\mathrm{NN}}=$ 7.7, 14.5, 19.6, 27, 39, 62.4 and 200 GeV and Pb+Pb at $\sqrt{s_\mathrm{NN}}=2.76$ TeV, respectively. It is found that the ratio $N_t N_p/N_d^2$ of the proton yield $N_p$, deuteron yield $N_d$ and triton yield $N_t$ exhibits a scaling behavior in its multiplicity dependence, i.e., decreasing monotonically with increasing charged-particle multiplicity. A similar multiplicity scaling of this ratio is also found in the nucleon coalescence calculation based on kinetic freeze-out nucleons from a multiphase transport (AMPT) model. The scaling behavior of $N_t N_p/N_d^2$ can be naturally explained by the interplay between the sizes of light nuclei and the nucleon emission source. We further argue that the multiplicity scaling of $N_t N_p/N_d^2$ can be used to validate the production mechanism of light nuclei, and the collision energy dependence of this yield ratio can further serve as a baseline in the search for the QCD critical point in relativistic heavy-ion collisions.


title: An Incremental Gradient Method for Optimization Problems with Variational Inequality Constraints

abstract: We consider minimizing a sum of agent-specific nondifferentiable merely convex functions over the solution set of a variational inequality (VI) problem in that each agent is associated with a local monotone mapping. This problem finds an application in computation of the best equilibrium in nonlinear complementarity problems arising in transportation networks. We develop an iteratively regularized incremental gradient method where at each iteration, agents communicate over a cycle graph to update their solution iterates using their local information about the objective and the mapping. The proposed method is single-timescale in the sense that it does not involve any excessive hard-to-project computation per iteration. We derive non-asymptotic agent-wise convergence rates for the suboptimality of the global objective function and infeasibility of the VI constraints measured by a suitably defined dual gap function. The proposed method appears to be the first fully iterative scheme equipped with iteration complexity that can address distributed optimization problems with VI constraints over cycle graphs. Preliminary numerical experiments for a transportation network problem and a support vector machine model are presented.