title: Detecting gravitational lenses using machine learning: exploring interpretability and sensitivity to rare lensing configurations

abstract: Forthcoming large imaging surveys such as Euclid and the Vera Rubin Observatory Legacy Survey of Space and Time are expected to find more than $10^5$ strong gravitational lens systems, including many rare and exotic populations such as compound lenses, but these $10^5$ systems will be interspersed among much larger catalogues of $\sim10^9$ galaxies. This volume of data is too much for visual inspection by volunteers alone to be feasible and gravitational lenses will only appear in a small fraction of these data which could cause a large amount of false positives. Machine learning is the obvious alternative but the algorithms' internal workings are not obviously interpretable, so their selection functions are opaque and it is not clear whether they would select against important rare populations. We design, build, and train several Convolutional Neural Networks (CNNs) to identify strong gravitational lenses using VIS, Y, J, and H bands of simulated data, with F1 scores between 0.83 and 0.91 on 100,000 test set images. We demonstrate for the first time that such CNNs do not select against compound lenses, obtaining recall scores as high as 76\% for compound arcs and 52\% for double rings. We verify this performance using Hubble Space Telescope (HST) and Hyper Suprime-Cam (HSC) data of all known compound lens systems. Finally, we explore for the first time the interpretability of these CNNs using Deep Dream, Guided Grad-CAM, and by exploring the kernels of the convolutional layers, to illuminate why CNNs succeed in compound lens selection.


title: Towards Automated Video Game Testing: Still a Long Way to Go

abstract: As the complexity and scope of game development increase, playtesting remains an essential activity to ensure the quality of video games. Yet, the manual, ad-hoc nature of playtesting gives space to improvements in the process. In this study, we investigate gaps between academic solutions in the literature for automated video game testing and the needs of video game developers in the industry. We performed a literature review on video game automated testing and applied an online survey with video game developers. The literature results show a rise in research topics related to automated video game testing. The survey results show that game developers are skeptical about using automated agents to test games. We conclude that there is a need for new testing approaches that did not disrupt the developer workflow. As for the researchers, the focus should be on the testing goal and testing oracle.


title: CCOMPASSION: A Hybrid Cloudlet Placement Framework over Passive Optical Access Networks

abstract: Cloud-based computing technology is one of the most significant technical advents of the last decade and extension of this facility towards access networks by aggregation of cloudlets is a step further. To fulfill the ravenous demand for computational resources entangled with the stringent latency requirements of computationally-heavy applications related to augmented reality, cognitive assistance and context-aware computation, installation of cloudlets near the access segment is a very promising solution because of its support for wide geographical network distribution, low latency, mobility and heterogeneity. In this paper, we propose a novel framework, Cloudlet Cost OptiMization over PASSIve Optical Network (CCOMPASSION), and formulate a nonlinear mixed-integer program to identify optimal cloudlet placement locations such that installation cost is minimized whilst meeting the capacity and latency constraints. Considering urban, suburban and rural scenarios as commonly-used network deployment models, we investigate the feasibility of the proposed model over them and provide guidance on the overall cloudlet facility installation over optical access network. We also study the percentage of incremental energy budget in the presence of cloudlets of the existing network. The final results from our proposed model can be considered as fundamental cornerstones for network planning with hybrid cloudlet network architectures.


title: Orbits and adiabatic contraction in scalar field dark matter halos: revisiting the cusp-core problem in dwarf galaxies

abstract: Bose-Einstein-condensed dark matter, also called scalar-field dark matter (SFDM), has become a popular alternative to cold dark matter (CDM), because it predicts galactic cores, in contrast to the cusps of CDM halos ("cusp-core problem"). We continue the study of SFDM with a strong, repulsive self-interaction; the Thomas-Fermi regime of SFDM (SFDM-TF). In this model, structure formation is suppressed below a scale related to the TF radius $R_\text{TF}$, which is close to the radius of central cores in these halos. We investigate for the first time the impact of baryons onto realistic galactic SFDM-TF halo profiles by studying the process of adiabatic contraction (AC) in such halos. In doing so, we first analyse the underlying quantum Hamilton-Jacobi framework appropriate for SFDM and calculate dark matter orbits, in order to verify the validity of the assumptions usually required for AC. Then, we calculate the impact of AC onto SFDM-TF halos of mass $\sim 10^{11}~M_{\odot}$, with various baryon fractions and core radii, $R_\text{TF} \sim (0.1 - 4)$ kpc, and compare our results with observational velocity data of dwarf galaxies. We find that AC-modified SFDM-TF halos with kpc-size core radii reproduce the data well, suggesting stellar feedback may not be required. On the other hand, halos with sub-kpc core radii face the same issue than CDM, in that they are not in accordance with galaxy data in the central halo parts.


title: Model Comparison and Calibration Assessment: User Guide for Consistent Scoring Functions in Machine Learning and Actuarial Practice

abstract: One of the main tasks of actuaries and data scientists is to build good predictive models for certain phenomena such as the claim size or the number of claims in insurance. These models ideally exploit given feature information to enhance the accuracy of prediction. This user guide revisits and clarifies statistical techniques to assess the calibration or adequacy of a model on the one hand, and to compare and rank different models on the other hand. In doing so, it emphasises the importance of specifying the prediction target functional at hand a priori (e.g. the mean or a quantile) and of choosing the scoring function in model comparison in line with this target functional. Guidance for the practical choice of the scoring function is provided. Striving to bridge the gap between science and daily practice in application, it focuses mainly on the pedagogical presentation of existing results and of best practice. The results are accompanied and illustrated by two real data case studies on workers' compensation and customer churn.


title: Magneto-optical rotation: Accurate approximated analytical solutions for single probe atomic magnetometers

abstract: We report an approximated analytical solution for a single-probe four-state atomic magnetometer where no analytical solution exists. This approximated analytical solution demonstrates excellent accuracy in broad probe power and detuning ranges when compared with the numerical solution obtained using a 4th order Runge-Kutta differential equation solver on MATLAB. The theoretical framework and results also encompass widely applied single-probe three-state atomic magnetometers for which no analytical solution, even approximated, is available to date in small detuning regions.


title: A narrow-stencil framework for convergent numerical approximations of fully nonlinear second order PDEs

abstract: This paper develops a unified general framework for designing convergent finite difference and discontinuous Galerkin methods for approximating viscosity and regular solutions of fully nonlinear second order PDEs. Unlike the well-known monotone (finite difference) framework, the proposed new framework allows for the use of narrow stencils and unstructured grids which makes it possible to construct high order methods. The general framework is based on the concepts of consistency and g-monotonicity which are both defined in terms of various numerical derivative operators. Specific methods that satisfy the framework are constructed using numerical moments. Admissibility, stability, and convergence properties are proved, and numerical experiments are provided along with some computer implementation details.


title: Jet modifications from colour rope formation in dense systems of non-parallel strings

abstract: We revisit our rope model for string fragmentation that has been shown to give a reasonable description of strangeness and baryon enhancement in high-multiplicity pp events at the LHC. A key feature of the model is that the enhancement is driven by the increased string tension due to strings overlapping in dense systems. By introducing an improved space-time picture for the overlap between fragmenting strings, where also non-parallel strings are properly taken into account, we are now able to investigate the enhancement both in jets and in the underlying event in a consistent way.


title: Localization of gravitational waves using machine learning

abstract: An observation of gravitational waves is a trigger of the multi-messenger search of an astronomical event. A combination of the data from two or three gravitational wave telescopes indicates the location of a source and low-latency data analysis is key to transferring the information to other telescopes sensitive at different wavelengths. In contrast to the current method, which relies on the matched-filtering technique, we proposed the use of machine learning that is much faster and possibly more accurate than matched filtering. Our machine-learning method is a combination of the method proposed by Chatterjee {\it et al.} and a method using the temporal convolutional network. We demonstrate the sky localization of a gravitational-wave source using four telescopes: LIGO H1, LIGO L1, Virgo, and KAGRA, and compare the result in the case without KAGRA to examine the positive influence of having the fourth telescope in the global gravitational-wave network.


title: Confidence Calibration for Object Detection and Segmentation

abstract: Calibrated confidence estimates obtained from neural networks are crucial, particularly for safety-critical applications such as autonomous driving or medical image diagnosis. However, although the task of confidence calibration has been investigated on classification problems, thorough investigations on object detection and segmentation problems are still missing. Therefore, we focus on the investigation of confidence calibration for object detection and segmentation models in this chapter. We introduce the concept of multivariate confidence calibration that is an extension of well-known calibration methods to the task of object detection and segmentation. This allows for an extended confidence calibration that is also aware of additional features such as bounding box/pixel position, shape information, etc. Furthermore, we extend the expected calibration error (ECE) to measure miscalibration of object detection and segmentation models. We examine several network architectures on MS COCO as well as on Cityscapes and show that especially object detection as well as instance segmentation models are intrinsically miscalibrated given the introduced definition of calibration. Using our proposed calibration methods, we have been able to improve calibration so that it also has a positive impact on the quality of segmentation masks as well.


title: Behaviorally Grounded Model-Based and Model Free Cost Reduction in a Simulated Multi-Echelon Supply Chain

abstract: Amplification and phase shift in ordering signals, commonly referred to as bullwhip, are responsible for both excessive strain on real world inventory management systems, stock outs, and unnecessary capital reservation though safety stock building. Bullwhip is a classic, yet persisting, problem with reverberating consequences in inventory management. Research on bullwhip has consistently emphasized behavioral influences for this phenomenon and leveraged behavioral ordering models to suggest interventions. However more recent model-free approaches have also seen success. In this work, the author develops algorithmic approaches towards mitigating bullwhip using both behaviorally grounded model-based approaches alongside a model-free dual deep Q-network reinforcement learning approach. In addition to exploring the utility of this specific model-free architecture to multi-echelon supply chains with imperfect information sharing and information delays, the author directly compares the performance of these model-based and model-free approaches. In doing so, this work highlights both the insights gained from exploring model-based approaches in the context of prior behavioral operations management literature and emphasizes the complementary nature of model-based and model-free approaches in approaching behaviorally grounded supply chain management problems.


title: Testing Symmetry for Bivariate Copulas using Bernstein Polynomials

abstract: In this work, tests of symmetry for bivariate copulas are introduced and studied using empirical Bernstein copula process. Three statistics are proposed and their asymptotic properties are established. Besides, a multiplier bootstrap Bernstein version is investigated for implementation purpose. The simulation study demonstrated the superior performance of the Bernstein tests compared to tests based on empirical copulas. Furthermore, in real data applications, these tests consistently yielded similar conclusions across a diverse range of scenarios.


title: Sensing accident-prone features in urban scenes for proactive driving and accident prevention

abstract: In urban cities, visual information on and along roadways is likely to distract drivers and lead to missing traffic signs and other accident-prone (AP) features. To avoid accidents due to missing these visual cues, this paper proposes a visual notification of AP-features to drivers based on real-time images obtained via dashcam. For this purpose, Google Street View images around accident hotspots (areas of dense accident occurrence) identified by a real-accident dataset are used to train a novel attention module to classify a given urban scene into an accident hotspot or a non-hotspot (area of sparse accident occurrence). The proposed module leverages channel, point, and spatial-wise attention learning on top of different CNN backbones. This leads to better classification results and more certain AP-features with better contextual knowledge when compared with CNN backbones alone. Our proposed module achieves up to 92% classification accuracy. The capability of detecting AP-features by the proposed model were analyzed by a comparative study of three different class activation map (CAM) methods, which were used to inspect specific AP-features causing the classification decision. Outputs of CAM methods were processed by an image processing pipeline to extract only the AP-features that are explainable to drivers and notified using a visual notification system. Range of experiments was performed to prove the efficacy and AP-features of the system. Ablation of the AP-features taking 9.61%, on average, of the total area in each image increased the chance of a given area to be classified as a non-hotspot by up to 21.8%.


title: Kinematical Analysis of Substructure in the Southern Periphery of the Large Magellanic Cloud

abstract: We report the first 3-D kinematical measurements of 88 stars in the direction of several recently discovered substructures in the southern periphery of the Large Magellanic Cloud (LMC) using a combination of Gaia proper motions and radial velocities from the APOGEE-2 survey. More specifically, we explore stars lie in assorted APOGEE-2 pointings in a region of the LMC periphery where various overdensities of stars have previously been identified in maps of stars from Gaia and DECam. By using a model of the LMC disk rotation, we find that a sizeable fraction of the APOGEE-2 stars have extreme space velocities that are distinct from, and not a simple extension of, the LMC disk. Using N-body hydrodynamical simulations of the past dynamical evolution and interaction of the LMC and Small Magellanic Cloud (SMC), we explore whether the extreme velocity stars may be accounted for as tidal debris created in the course of that interaction. We conclude that the combination of LMC and SMC debris produced from their interaction is a promising explanation, although we cannot rule out other possible origins, and that these new data should be used to constrain future simulations of the LMC-SMC interaction. We also conclude that many of the stars in the southern periphery of the LMC lie out of the LMC plane by several kpc. Given that the metallicity of these stars suggest they are likely of Magellanic origin, our results suggest that a wider exploration of the past interaction history of the Magellanic Clouds is needed.


title: A Unifying Approach to Distributional Limits for Empirical Optimal Transport

abstract: We provide a unifying approach to central limit type theorems for empirical optimal transport (OT). In general, the limit distributions are characterized as suprema of Gaussian processes. We explicitly characterize when the limit distribution is centered normal or degenerates to a Dirac measure. Moreover, in contrast to recent contributions on distributional limit laws for empirical OT on Euclidean spaces which require centering around its expectation, the distributional limits obtained here are centered around the population quantity, which is well-suited for statistical applications. At the heart of our theory is Kantorovich duality representing OT as a supremum over a function class $\mathcal{F}_{c}$ for an underlying sufficiently regular cost function $c$. In this regard, OT is considered as a functional defined on $\ell^{\infty}(\mathcal{F}_{c})$ the Banach space of bounded functionals from $\mathcal{F}_{c}$ to $\mathbb{R}$ and equipped with uniform norm. We prove the OT functional to be Hadamard directional differentiable and conclude distributional convergence via a functional delta method that necessitates weak convergence of an underlying empirical process in $\ell^{\infty}(\mathcal{F}_{c})$. The latter can be dealt with empirical process theory and requires $\mathcal{F}_{c}$ to be a Donsker class. We give sufficient conditions depending on the dimension of the ground space, the underlying cost function and the probability measures under consideration to guarantee the Donsker property. Overall, our approach reveals a noteworthy trade-off inherent in central limit theorems for empirical OT: Kantorovich duality requires $\mathcal{F}_{c}$ to be sufficiently rich, while the empirical processes only converges weakly if $\mathcal{F}_{c}$ is not too complex.


title: Symbol repetition in interstellar communications: methods and observations

abstract: Discoverable interstellar communication signals are expected to exhibit al least one signal characteristic clearly distinct from random noise. A hypothesis is proposed that radio telescope received signals may contain transmitted delta-t delta-f opposite circular polarized pulse pairs, conveying a combination of information content and discovery methods, including symbol repetition. Hypothetical signals are experimentally measured using a 26 foot diameter radio telescope, a chosen matched filter receiver, and machine post processing system. Measurements are expected to present likelihoods explained by an Additive White Gaussian Noise model, augmented to reduce radio frequency interference. In addition, measurements are expected to present no significant differences across a population of Right Ascension ranges, during long duration experiments. The hypothesis and experimental methods described in this paper are based on multiple radio telescope delta-t delta-f polarized pulse pair experiments previously reported. (ref. arXiv:2105.03727, arXiv:2106.10168). In the current work, a Right Ascension filter spans twenty-one 0.3 hour Right Ascension bins over a 0 to 6.3 hr range, during a 143 day experiment. Apparent symbol repetition is measured and analyzed. The 5.25 plus or minus 0.15 hr Right Ascension, -7.6 degree plus or minus 1 degree Declination celestial direction has been associated with anomalous observations in previous work, and continues to present anomalies, having unknown cause.


title: Separable symmetric tensors and separable anti-symmetric tensors

abstract: In this paper, we first introduce the invertibility of even-order tensors and the separable tensors, including separable symmetry tensors and separable anti-symmetry tensors, defined respectively as the sum and the algebraic sum of rank-1 tensors generated by the tensor product of some vectors, say, $v_{1}, v_{2}, \ldots, v_{m}$. We show that the $m!$ sumrands, each in form $v_{\sigma(1)}\times v_{\sigma(2)}\times\ldots\times v_{\sigma(m)}$, are linearly independent if $v_{1},v_{2}, \ldots, v_{m}$ are linearly independent, where $\sigma$ is any permutation on $\set{1,2,\ldots,m}$. We offer a class of tensors to achieve the upper bound for $\rank(A) \leq 6$ for all $A\in R^{3\times 3\times 3}$. We also show that each $3\times 3\times 3$ anti-symmetric tensor is separable.


title: Towards Optimal Lower Bounds for k-median and k-means Coresets

abstract: Given a set of points in a metric space, the $(k,z)$-clustering problem consists of finding a set of $k$ points called centers, such that the sum of distances raised to the power of $z$ of every data point to its closest center is minimized. Special cases include the famous k-median problem ($z = 1$) and k-means problem ($z = 2$). The $k$-median and $k$-means problems are at the heart of modern data analysis and massive data applications have given raise to the notion of coreset: a small (weighted) subset of the input point set preserving the cost of any solution to the problem up to a multiplicative $(1 \pm \varepsilon)$ factor, hence reducing from large to small scale the input to the problem. In this paper, we present improved lower bounds for coresets in various metric spaces. In finite metrics consisting of $n$ points and doubling metrics with doubling constant $D$, we show that any coreset for $(k,z)$ clustering must consist of at least $\Omega(k \varepsilon^{-2} \log n)$ and $\Omega(k \varepsilon^{-2} D)$ points, respectively. Both bounds match previous upper bounds up to polylog factors. In Euclidean spaces, we show that any coreset for $(k,z)$ clustering must consists of at least $\Omega(k\varepsilon^{-2})$ points. We complement these lower bounds with a coreset construction consisting of at most $\tilde{O}(k\varepsilon^{-2}\cdot \min(\varepsilon^{-z},k))$ points.


title: Far-Field Expansions for Harmonic Maps and the Electrostatics Analogy in Nematic Suspensions

abstract: For a smooth bounded domain $G\subset\mathbb{R}^3$ we consider maps $n\colon\mathbb R^3\setminus G\to\mathbb S^2$ minimizing the energy $E(n)=\int_{\mathbb R^3\setminus G}|\nabla n|^2 +F_s(n_{\lfloor\partial G})$ among $\mathbb S^2$-valued map such that $n(x)\approx n_0$ as $|x|\to\infty$. This is a model for a particle $G$ immersed in nematic liquid crystal. The surface energy $F_s$ describes the anchoring properties of the particle, and can be quite general. We prove that such minimizing map $n$ has an asymptotic expansion in powers of $1/r$. Further, we show that the leading order $1/r$ term is uniquely determined by the far-field condition $n_0$ for almost all $n_0\in\mathbb S^2$, by relating it to the gradient of the minimal energy with respect to $n_0$. We derive various consequences of this relation in physically motivated situations: when the orientation of the particle $G$ is stable relative to a prescribed far-field alignment $n_0$; and when the particle $G$ has some rotational symmetries. In particular, these corollaries justify some approximations that can be found in the physics literature to describe nematic suspensions via a so-called electrostatics analogy.


title: Equilibrium Aggregation: Encoding Sets via Optimization

abstract: Processing sets or other unordered, potentially variable-sized inputs in neural networks is usually handled by aggregating a number of input tensors into a single representation. While a number of aggregation methods already exist from simple sum pooling to multi-head attention, they are limited in their representational power both from theoretical and empirical perspectives. On the search of a principally more powerful aggregation strategy, we propose an optimization-based method called Equilibrium Aggregation. We show that many existing aggregation methods can be recovered as special cases of Equilibrium Aggregation and that it is provably more efficient in some important cases. Equilibrium Aggregation can be used as a drop-in replacement in many existing architectures and applications. We validate its efficiency on three different tasks: median estimation, class counting, and molecular property prediction. In all experiments, Equilibrium Aggregation achieves higher performance than the other aggregation techniques we test.


title: Hybrid Robotic Grasping with a Soft Multimodal Gripper and a Deep Multistage Learning Scheme

abstract: Grasping has long been considered an important and practical task in robotic manipulation. Yet achieving robust and efficient grasps of diverse objects is challenging, since it involves gripper design, perception, control and learning, etc. Recent learning-based approaches have shown excellent performance in grasping a variety of novel objects. However, these methods either are typically limited to one single grasping mode, or else more end effectors are needed to grasp various objects. In addition, gripper design and learning methods are commonly developed separately, which may not adequately explore the ability of a multimodal gripper. In this paper, we present a deep reinforcement learning (DRL) framework to achieve multistage hybrid robotic grasping with a new soft multimodal gripper. A soft gripper with three grasping modes (i.e., enveloping, sucking, and enveloping_then_sucking) can both deal with objects of different shapes and grasp more than one object simultaneously. We propose a novel hybrid grasping method integrated with the multimodal gripper to optimize the number of grasping actions. We evaluate the DRL framework under different scenarios (i.e., with different ratios of objects of two grasp types). The proposed algorithm is shown to reduce the number of grasping actions (i.e., enlarge the grasping efficiency, with maximum values of 161% in simulations and 154% in real-world experiments) compared to single grasping modes.


title: Learning Dynamic Mechanisms in Unknown Environments: A Reinforcement Learning Approach

abstract: Dynamic mechanism design studies how mechanism designers should allocate resources among agents in a time-varying environment. We consider the problem where the agents interact with the mechanism designer according to an unknown Markov Decision Process (MDP), where agent rewards and the mechanism designer's state evolve according to an episodic MDP with unknown reward functions and transition kernels. We focus on the online setting with linear function approximation and propose novel learning algorithms to recover the dynamic Vickrey-Clarke-Grove (VCG) mechanism over multiple rounds of interaction. A key contribution of our approach is incorporating reward-free online Reinforcement Learning (RL) to aid exploration over a rich policy space to estimate prices in the dynamic VCG mechanism. We show that the regret of our proposed method is upper bounded by $\tilde{\mathcal{O}}(T^{2/3})$ and further devise a lower bound to show that our algorithm is efficient, incurring the same $\tilde{\mathcal{O}}(T^{2 / 3})$ regret as the lower bound, where $T$ is the total number of rounds. Our work establishes the regret guarantee for online RL in solving dynamic mechanism design problems without prior knowledge of the underlying model.


title: Decomposition of tracial positive maps and applications in quantum information

abstract: Every positive multilinear map between $C^*$-algebras is separately weak$^*$-continuous. We show that the joint weak$^*$-continuity is equivalent to the joint weak$^*$-continuity of the multiplications of $C^*$-algebras under consideration. We study the behavior of general tracial positive maps on properly infinite von Neumann algebras and by applying the Aron--Berner extension of multilinear maps, we establish that under some mild conditions every tracial positive multilinear map between general $C^*$-algebras enjoys a decomposition $\Phi=\varphi_2 \circ \varphi_1$, in which $\varphi_1$ is a tracial positive linear map with the commutative range and $\varphi_2$ is a tracial completely positive map with the commutative domain. As an immediate consequence, tracial positive multilinear maps are completely positive. Furthermore, we prove that if the domain of a general tracial completely positive map $\Phi$ between $C^*$-algebra is a von Neumann algebra, then $\Phi$ has a similar decomposition. As an application, we investigate the generalized variance and covariance in quantum mechanics via arbitrary positive maps. Among others, an uncertainty relation inequality for commuting observables in a composite physical system is presented.


title: Subjective Functionality and Comfort Prediction for Apartment Floor Plans and Its Application to Intuitive Searches

abstract: This study presents a new user experience in apartment searches using functionality and comfort as query items. This study has three technical contributions. First, we present a new dataset on the perceived functionality and comfort scores of residential floor plans using nine question statements about the level of comfort, openness, privacy, etc. Second, we propose an algorithm to predict the scores from the floor plan images. Lastly, we implement a new apartment search system and conduct a large-scale usability study using crowdsourcing. The experimental results show that our apartment search system can provide a better user experience. To the best of our knowledge, this study is the first work to propose a highly accurate prediction model for the subjective functionality and comfort of apartments using machine learning.


title: Precise radial velocities of giant stars XVI. Planet occurrence rates from the combined analysis of the Lick, EXPRESS, and PPPS giant star surveys

abstract: RV surveys of evolved stars allow us to probe a higher stellar mass range compared to main-sequence samples. Differences between the planet populations can be caused by either the differing stellar mass or stellar evolution. To properly disentangle the effects of both, the planet population around giant stars needs to be characterized as accurately as possible. Our goal is to investigate the giant planet occurrence rate around evolved stars and determine its dependence on stellar mass, metallicity, and orbital period. We combine data from the Lick, EXPRESS, and PPPS giant star surveys, yielding a sample of 482 evolved stars and 37 planets. We homogeneously rederived the stellar parameters and accounted for varying observational coverage, precision, and stellar noise properties by computing detection maps via injection and retrieval of synthetic planetary signals. We then computed occurrence rates as a function of period, stellar mass, and metallicity, corrected for incompleteness. Our findings agree with previous studies that found a positive planet-metallicity correlation for evolved stars and identified a peak in the occurrence rate as a function of stellar mass, but our results place it at a slightly smaller mass of 1.68Msun. The period dependence of the occurrence rate seems to follow a broken power-law or log-normal peaking at 700-800 days, roughly corresponding to 1.6AU for a 1Msun star and 2.0AU for a 2Msun star. This peak could be a remnant from halted migration around intermediate-mass stars, caused by stellar evolution, or an artifact from contamination by false positives. The global occurrence rate of giant planetary systems is 10.7% for the entire sample, while the subsets of RGB and HB stars exhibit 14.2% and 6.6%, respectively. However, we demonstrate that the different stellar mass distributions suffice to explain the apparent change of occurrence with evolutionary stage.


title: On the data requirements of probing

abstract: As large and powerful neural language models are developed, researchers have been increasingly interested in developing diagnostic tools to probe them. There are many papers with conclusions of the form "observation X is found in model Y", using their own datasets with varying sizes. Larger probing datasets bring more reliability, but are also expensive to collect. There is yet to be a quantitative method for estimating reasonable probing dataset sizes. We tackle this omission in the context of comparing two probing configurations: after we have collected a small dataset from a pilot study, how many additional data samples are sufficient to distinguish two different configurations? We present a novel method to estimate the required number of data samples in such experiments and, across several case studies, we verify that our estimations have sufficient statistical power. Our framework helps to systematically construct probing datasets to diagnose neural NLP models.


title: Probabilistic Data Association for Semantic SLAM at Scale

abstract: With advances in image processing and machine learning, it is now feasible to incorporate semantic information into the problem of simultaneous localisation and mapping (SLAM). Previously, SLAM was carried out using lower level geometric features (points, lines, and planes) which are often view-point dependent and error prone in visually repetitive environments. Semantic information can improve the ability to recognise previously visited locations, as well as maintain sparser maps for long term SLAM applications. However, SLAM in repetitive environments has the critical problem of assigning measurements to the landmarks which generated them. In this paper, we use k-best assignment enumeration to compute marginal assignment probabilities for each measurement landmark pair, in real time. We present numerical studies on the KITTI dataset to demonstrate the effectiveness and speed of the proposed framework.


title: Development of a Model Predictive Airpath Controller for a Diesel Engine on a High-Fidelity Engine Model with Transient Thermal Dynamics

abstract: This paper presents the results of a model predictive controller (MPC) development for diesel engine air-path regulation. The control objective is to track the intake manifold pressure and exhaust gas recirculation (EGR) rate targets by manipulating the EGR valve and variable geometry turbine (VGT) while satisfying state and control constraints. The MPC controller is designed and verified using a high-fidelity engine model in GT-Power. The controller exploits a low-order rate-based linear parameter-varying (LPV) model for prediction which is identified from transient response data generated by the GT-Power model. It is shown that transient engine thermal dynamics influence the airpath dynamics, specifically the intake manifold pressure response, however, MPC demonstrates robustness against inaccuracies in modeling these thermal dynamics. In particular, we show that MPC can be successfully implemented using a rate-based prediction model with two inputs (EGR and VGT positions) identified from data with steady-state wall temperature dynamics, however, closed-loop performance can be improved if a prediction model (i) is identified from data with transient thermal dynamics, and (ii) has the fuel injection rate as extra model input. Further, the MPC calibration process across the engine operating range to achieve improved performance is addressed. As the MPC calibration is shown to be sensitive to the operating conditions, a fast calibration process is proposed.


title: Hadronization and Color Transparency

abstract: In this article we review our work on the production of hadrons in the nuclear environment. We work with a string-breaking model for the initial production of hadrons and with a quantum-kinetic transport model (GiBUU) to describe the final state interactions of the newly formed (pre)hadrons. The latter are determined both by the formation times and by the time-development of the hadron-hadron cross section. We first show that only a linear time-dependence is able to describe the available hadronization data. We then compare with detailed data from HERMES and JLAB; very good agreement is reached in all reactions studied without any tuning of parameters. We also repeat predictions of spectra for pions and kaons at JLAB@12GeV. We finally explain the absence of CT effects in the recent experiment on proton transparencies in quasielastic (QE) events on nuclei. We propose to look instead for CT effects on protons in semi-inclusive DIS (SIDIS) events.


title: Integrable sigma models on Riemann surfaces

abstract: We consider quantum aspects of a class of generalized Gross-Neveu models, which in special cases reduce to sigma models. We show that, in the case of gauged models, an admissible gauge is $A_\mu=0$, which is a direct analogue of the conformal gauge in string models. Chiral anomalies are a gauge counterpart of the Weyl anomaly, and are required to vanish. Topological effects on the worldsheet lead to an integration over moduli spaces of connections on a Riemann surface. This is an initial step in studying the effects of worldsheet geometry and topology in integrable sigma models.


title: Deep learning-assisted imaging through stationary scattering media

abstract: Imaging through scattering media is a challenging problem owing to speckle decorrelations from perturbations in the media itself. For in-line imaging modalities, which are appealing because they are compact, require no moving parts, and are robust, negating the effects of such scattering becomes particularly challenging. Here we explore the effect of stationary scattering media on light scattering in in-line geometries, including digital holographic microscopy. We consider various object-scatterer scenarios where the object is distorted or obscured by additional stationary scatterers, and use an advanced deep learning (DL) generative methodology, generative adversarial networks (GANs), to mitigate the effects of the additional scatterers. Using light scattering simulations and experiments on objects of interest with and without additional scatterers, we find that conditional GANs can be quickly trained with minuscule datasets and can also efficiently learn the one-to-one statistical mapping between the cross-domain input-output image pairs. Training such a network yields a standalone model, that can be used later to inverse or negate the effect of scattering, yielding clear object reconstructions for object retrieval and downstream processing. Moreover, it is well-known that the coherent point spread function (c-PSF) of a stationary scattering optical system is a speckle pattern which is spatially shift variant. We show that with rapid training using only 20 image pairs, it is possible to negate this undesired scattering to accurately localize diffraction-limited impulses with high spatial accuracy, therefore transforming the earlier shift variant system to a linear shift invariant (LSI) system.


title: EXFOR-NSR PDF database: a system for nuclear knowledge preservation and data curation

abstract: Current needs of nuclear science and technology include complete, well-documented, and easily verifiable nuclear data. The complete data records require supporting nuclear bibliography, presently stored in dedicated libraries, in addition, to actual data. Experimental nuclear reaction data (EXFOR) and Nuclear Science References (NSR) databases contain compilations based on primary (journals) and secondary (conference proceedings, theses, preprints, etc.) publications, and data received from authors via private communications. The secondary library materials and private communications often represent a bottleneck for nuclear data verification, compilation, evaluation, and dissemination activities. To address this issue, bibliographic materials were scanned into PDF (Portable Document Format) files and uploaded in a relational database. The traditional scope of nuclear databases that includes meta-data and numbers derived from data in specialized formats was broadened to accommodate the large volumes of original nuclear data publications. The complete PDF publication files were stored in a relational database as Binary Large OBjects (BLOB). This unique collection of nuclear data compilations and supporting publications generate many opportunities for machine learning applications.


title: High-Dimensional Sparse Bayesian Learning without Covariance Matrices

abstract: Sparse Bayesian learning (SBL) is a powerful framework for tackling the sparse coding problem. However, the most popular inference algorithms for SBL become too expensive for high-dimensional settings, due to the need to store and compute a large covariance matrix. We introduce a new inference scheme that avoids explicit construction of the covariance matrix by solving multiple linear systems in parallel to obtain the posterior moments for SBL. Our approach couples a little-known diagonal estimation result from numerical linear algebra with the conjugate gradient algorithm. On several simulations, our method scales better than existing approaches in computation time and memory, especially for structured dictionaries capable of fast matrix-vector multiplication.


title: Design development and implementation of an irradiation station at the neutron time-of-flight facility at CERN

abstract: A new parasitic, mixed-field, neutron-dominated irradiation station has been recently commissioned at the European Laboratory for Particle Physics (CERN). The station is installed in the Neutron Time-Of-Flight (n\_TOF) facility, taking advantage of the secondary radiation produced by the neutron spallation target. The new station allows radiation damage studies to be performed in irradiation conditions that are closer to the ones encountered during the operation of particle accelerators; the irradiation tests carried out in the station will be complementary to the standard tests on materials, usually performed with gamma sources. Samples will be exposed to neutron doses in the MGy range per year, with minimal impact on the n TOF facility operation. The station has twenty-four irradiation positions, each hosting up to 100 cm3 of sample material. In view of its proximity to the n\_TOF target, inside protective shielding, the irradiation station and its operating procedures have been carefully developed taking into account the safety of personnel and to avoid any unwanted impact on the operation of the n\_TOF facility and experiments. Due to the residual radioactivity of the whole area around the n\_TOF target and of the irradiated samples, access to the irradiation station is forbidden to human operators even when the n\_TOF facility is not in operation. Robots are used for the remote installation and retrieval of the samples, and other optimizations of the handling procedures were developed in compliance with radiation protection regulations and the aim of minimizing doses to personnel.


title: Measuring dynamical systems on directed hyper-graphs

abstract: Networks and graphs provide a simple but effective model to a vast set of systems which building blocks interact throughout pairwise interactions. Unfortunately, such models fail to describe all those systems which building blocks interact at a higher order. Higher order graphs provide us the right tools for the task, but introduce a higher computing complexity due to the interaction order. In this paper we analyze the interplay between the structure of a directed hypergraph and a linear dynamical system, a random walk, defined on it. How can one extend network measures, such as centrality or modularity, to this framework? Instead of redefining network measures through the hypergraph framework, with the consequent complexity boost, we will measure the dynamical system associated to it. This approach let us apply known measures to pairwise structures, such as the transition matrix, and determine a family of measures that are amenable of such procedure.


title: Does an increase in the cost of imported inputs hurt exports? Evidence from firms' network of foreign suppliers

abstract: This paper examines the relationship between changes in the cost of imported inputs and export performance using a novel dataset from Argentina which identifies domestic firms' network of foreign suppliers. To guide my empirical strategy, I construct a heterogeneous firm model subject to quality choice and frictions in the market for foreign supplier. The model predicts that the impact of an increase in the cost of imported inputs to be increasing in the adjustments costs of supplier linkages and in the quality of the product exported. I take the model to the data by constructing firm-specific shocks using a shift-share analysis which exploits firms' lagged exposure to foreign suppliers and finely defined import price shifts. Evidence suggests the presence of significant adjustment cost in firms' foreign supplier linkages and strong complementarities between imported inputs and export performance, particularly of high-quality products.


title: Ab initio study on the atomic and electronic structures of twisted InSe bilayer

abstract: The electronic properties of the twisted InSe bilayer are studied by large-scale density functional theory. Spectral Function Unfolding reveals that the electronic structure of the twisted system can be described in terms of a combination of features of the bandstructures of the aligned InSe bilayer with different stacking configurations, enabling predictions of the band gap and the effective mass for holes. The effective mass for holes in the twisted InSe bilayer is shown to be influenced primarily by the interlayer distance. The intralayer and interlayer exciton binding energies are thus calculated based on a model recently developed by Ruiz-Tijerina et al. We apply similar analysis to the trilayer heterostructure InSe/hBN/InSe: its electronic structure is shown to be well-described by the superposition of band structures of two InSe monolayers with a small coupling through the hBN layer.


title: Causal discovery for observational sciences using supervised machine learning

abstract: Causal inference can estimate causal effects, but unless data are collected experimentally, statistical analyses must rely on pre-specified causal models. Causal discovery algorithms are empirical methods for constructing such causal models from data. Several asymptotically correct methods already exist, but they generally struggle on smaller samples. Moreover, most methods focus on very sparse causal models, which may not always be a realistic representation of real-life data generating mechanisms. Finally, while causal relationships suggested by the methods often hold true, their claims about causal non-relatedness have high error rates. This non-conservative error tradeoff is not ideal for observational sciences, where the resulting model is directly used to inform causal inference: A causal model with many missing causal relations entails too strong assumptions and may lead to biased effect estimates. We propose a new causal discovery method that addresses these three shortcomings: Supervised learning discovery (SLdisco). SLdisco uses supervised machine learning to obtain a mapping from observational data to equivalence classes of causal models. We evaluate SLdisco in a large simulation study based on Gaussian data and we consider several choices of model size and sample size. We find that SLdisco is more conservative, only moderately less informative and less sensitive towards sample size than existing procedures. We furthermore provide a real epidemiological data application. We use random subsampling to investigate real data performance on small samples and again find that SLdisco is less sensitive towards sample size and hence seems to better utilize the information available in small datasets.


abstract: Our book "The Reality of Multi-Lingual Machine Translation" discusses the benefits and perils of using more than two languages in machine translation systems. While focused on the particular task of sequence-to-sequence processing and multi-task learning, the book targets somewhat beyond the area of natural language processing. Machine translation is for us a prime example of deep learning applications where human skills and learning capabilities are taken as a benchmark that many try to match and surpass. We document that some of the gains observed in multi-lingual translation may result from simpler effects than the assumed cross-lingual transfer of knowledge. In the first, rather general part, the book will lead you through the motivation for multi-linguality, the versatility of deep neural networks especially in sequence-to-sequence tasks to complications of this learning. We conclude the general part with warnings against too optimistic and unjustified explanations of the gains that neural networks demonstrate. In the second part, we fully delve into multi-lingual models, with a particularly careful examination of transfer learning as one of the more straightforward approaches utilizing additional languages. The recent multi-lingual techniques, including massive models, are surveyed and practical aspects of deploying systems for many languages are discussed. The conclusion highlights the open problem of machine understanding and reminds of two ethical aspects of building large-scale models: the inclusivity of research and its ecological trace.


title: Out-of-Time-Order correlators in driven conformal field theories

abstract: We compute Out-of-Time-Order correlators (OTOCs) for conformal field theories (CFTs) subjected to either continuous or discrete periodic drive protocols. This is achieved by an appropriate analytic continuation of the stroboscopic time. After detailing the general structure, we perform explicit calculations in large-$c$ CFTs where we find that OTOCs display an exponential, an oscillatory and a power-law behaviour in the heating phase, the non-heating phase and on the phase boundary, respectively. In contrast to this, for the Ising CFT representing an integrable model, OTOCs never display such exponential growth. This observation hints towards how OTOCs can demarcate between integrable and chaotic CFT models subjected to a periodic drive. We further explore properties of the light-cone which is characterized by the corresponding butterfly velocity as well as the Lyapunov exponent. Interestingly, as a consequence of the spatial inhomogeneity introduced by the drive, the butterfly velocity, in these systems, has an explicit dependence on the initial location of the operators. We chart out the dependence of the Lyapunov exponent and the butterfly velocities on the frequency and amplitude of the drive for both protocols and discuss the fixed point structure which differentiates such driven CFTs from their un-driven counterparts.


title: From Low to High Order Motion Planners: Safe Robot Navigation using Motion Prediction and Reference Governor

abstract: Safe navigation around obstacles is a fundamental challenge for highly dynamic robots. The state-of-the-art approach for adapting simple reference path planners to complex robot dynamics using trajectory optimization and tracking control is brittle and requires significant replanning cycles. In this paper, we introduce a novel feedback motion planning framework that extends the applicability of low-order (e.g. position-/velocity-controlled) reference motion planners to high-order (e.g., acceleration-/jerk-controlled) robot models using motion prediction and reference governors. We use predicted robot motion range for safety assessment and establish a bidirectional interface between high-level planning and low-level control via a reference governor. We describe the generic fundamental building blocks of our feedback motion planning framework and give specific example constructions for motion control, prediction, and reference planning. We prove the correctness of our planning framework and demonstrate its performance in numerical simulations. We conclude that accurate motion prediction is crucial for closing the gap between high-level planning and low-level control.


title: A Novel Greedy Approach To Harmonic Summing Using GPUs

abstract: Incoherent harmonic summing is a technique which is used to improve the sensitivity of Fourier domain search methods. A one dimensional harmonic sum is used in time-domain radio astronomy as part of the Fourier domain periodicity search, a type of search used to detect isolated single pulsars. The main problem faced when implementing the harmonic sum on many-core architectures, like GPUs, is the very unfavourable memory access pattern of the harmonic sum algorithm. The memory access pattern gets worse as the dimensionality of the harmonic sum increases. Here we present a set of algorithms for calculating the harmonic sum that are suited to many-core architectures such as GPUs. We present an evaluation of the sensitivity of these different approaches, and their performance. This work forms part of the AstroAccelerate project which is a GPU accelerated software package for processing time-domain radio astronomy data.


title: Improving generalization with synthetic training data for deep learning based quality inspection

abstract: Automating quality inspection with computer vision techniques is often a very data-demanding task. Specifically, supervised deep learning requires a large amount of annotated images for training. In practice, collecting and annotating such data is not only costly and laborious, but also inefficient, given the fact that only a few instances may be available for certain defect classes. If working with video frames can increase the number of these instances, it has a major disadvantage: the resulting images will be highly correlated with one another. As a consequence, models trained under such constraints are expected to be very sensitive to input distribution changes, which may be caused in practice by changes in the acquisition system (cameras, lights), in the parts or in the defects aspect. In this work, we demonstrate the use of randomly generated synthetic training images can help tackle domain instability issues, making the trained models more robust to contextual changes. We detail both our synthetic data generation pipeline and our deep learning methodology for answering these questions.


title: Exploratory Hidden Markov Factor Models for Longitudinal Mobile Health Data: Application to Adverse Posttraumatic Neuropsychiatric Sequelae

abstract: Adverse posttraumatic neuropsychiatric sequelae (APNS) are common among veterans and millions of Americans after traumatic exposures, resulting in substantial burdens for trauma survivors and society. Despite numerous studies conducted on APNS over the past decades, there has been limited progress in understanding the underlying neurobiological mechanisms due to several unique challenges. One of these challenges is the reliance on subjective self-report measures to assess APNS, which can easily result in measurement errors and biases (e.g., recall bias). To mitigate this issue, in this paper, we investigate the potential of leveraging the objective longitudinal mobile device data to identify homogeneous APNS states and study the dynamic transitions and potential risk factors of APNS after trauma exposure. To handle specific challenges posed by longitudinal mobile device data, we developed exploratory hidden Markov factor models and designed a Stabilized Expectation-Maximization algorithm for parameter estimation. Simulation studies were conducted to evaluate the performance of parameter estimation and model selection. Finally, to demonstrate the practical utility of the method, we applied it to mobile device data collected from the Advancing Understanding of RecOvery afteR traumA (AURORA) study.


title: In-beam $\gamma$-ray spectroscopy of $^{32}$Mg via direct reactions

abstract: Background: The nucleus $^{32}$Mg ($N=20$ and $Z=12$) plays a central role in the so-called "island of inversion" where in the ground states $sd$-shell neutrons are promoted to the $fp$-shell orbitals across the shell gap, resulting in the disappearance of the canonical neutron magic number $N=20$. Purpose: The primary goals of this work are to extend the level scheme of $^{32}$Mg, provide spin-parity assignments to excited states, and discuss the microscopic structure of each state through comparisons with theoretical calculations. Method: In-beam $\gamma$-ray spectroscopy of $^{32}$Mg was performed using two direct-reaction probes, one-neutron (two-proton) knockout reactions on $^{33}$Mg ($^{34}$Si). Final-state exclusive cross sections and parallel momentum distributions were extracted from the experimental data and compared with eikonal-based reaction model calculations combined with shell-model overlap functions. Results: Owing to the remarkable selectivity of the one-neutron and two-proton knockout reactions, a significantly updated level scheme for $^{32}$Mg, which exhibits negative-parity intruder and positive-parity normal states, was constructed. The experimental results were confronted with four different nuclear structure models. Conclusions: In some of these models, different aspects of $^{32}$Mg and the transition into the island of inversion are well described. However, unexplained discrepancies remain, and even with the help of these state-of-the-art theoretical approaches, the structure of this key nucleus is not yet fully captured.


title: Cavity-mediated electron-photon pairs

abstract: Advancing quantum information, communication and sensing relies on the generation and control of quantum correlations in complementary degrees of freedom. Here, we demonstrate the preparation of electron-photon pair states using the phase-matched interaction of free electrons with the evanescent vacuum field of a photonic-chip-based optical microresonator. Spontaneous inelastic scattering produces intracavity photons coincident with energy-shifted electrons. Harnessing these pairs for correlation-enhanced imaging, we achieve a two-orders of magnitude contrast improvement in cavity-mode mapping by coincidence-gated electron spectroscopy. This parametric pair-state preparation will underpin the future development of free-electron quantum optics, providing a pathway to quantum-enhanced imaging, electron-photon entanglement, and heralded single-electron and Fock-state photon sources.


title: A novel hypothesis for how albatrosses optimize their flight physics in real-time: an extremum seeking model and control for dynamic soaring

abstract: The albatross optimized flight maneuver -- known as dynamic soaring -- is nothing but a wonder of biology, physics, and engineering. By utilizing dynamic soaring, the bird can travel in the desired flight direction almost for free by harvesting energy from the wind. Dynamic soaring biological inspiration has triggered a momentous interest among many communities of science and engineering. Studying, modeling, and simulating dynamic soaring have been conducted in literature by mostly configuring dynamic soaring as an optimal control problem. Said configuration requires accurate dynamic system modeling of the albatross/mimicking-object, accurate wind profile models, and a defined mathematical formula of an objective function that aims at conserving energy and minimizing its dissipation. However, the experimental observations of albatrosses indicate their ability to conduct dynamic soaring in real time. Indeed, a functioning modeling and control framework for dynamic soaring that allows for a meaningful bio-mimicry of the albatross needs to be autonomous, real-time, stable, and capable of tolerating the absence of mathematical expressions of the wind profiles and the objective function, hypothetically similar to what the bird does. The qualifications of such modeling and control framework are the very same characteristics of the so-called extremum seeking systems. In this paper, we propose an extremum seeking modeling and control framework for the dynamic soaring problem. We provide and discuss the problem setup, design, and stability of the introduced framework. Our results, supported by simulations and comparison with optimal control methods of the literature, provide a proof of concept that the dynamic soaring phenomenon can be a natural expression of extremum seeking. Hence, dynamic soaring has the potential to be performed autonomously and in real-time with stability guarantees.


title: Gen\'eLive! Generating Rhythm Actions in Love Live!

abstract: This article presents our generative model for rhythm action games together with applications in business operations. Rhythm action games are video games in which the player is challenged to issue commands at the right timings during a music session. The timings are rendered in the chart, which consists of visual symbols, called notes, flying through the screen. We introduce our deep generative model, Gen\'eLive!, which outperforms the state-of-the-art model by taking into account musical structures through beats and temporal scales. Thanks to its favorable performance, Gen\'eLive! was put into operation at KLab Inc., a Japan-based video game developer, and reduced the business cost of chart generation by as much as half. The application target included the phenomenal "Love Live!," which has more than 10 million users across Asia and beyond, and is one of the few rhythm action franchises that has led the online era of the genre. In this article, we evaluate the generative performance of Gen\'eLive! using production datasets at KLab as well as open datasets for reproducibility, while the model continues to operate in their business. Our code and the model, tuned and trained using a supercomputer, are publicly available.


title: The k-outlier Fr\'echet distance

abstract: The Fr\'echet distance is a popular metric for curves; however, its bottleneck character is a disadvantage in many applications. Here we introduce two variants of the Fr\'echet distance to cope with this problem and expand the work on shortcut Fr\'echet distances. We present an efficient algorithm for computing the new distance measure.


title: NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactions

abstract: 4D modeling of human-object interactions is critical for numerous applications. However, efficient volumetric capture and rendering of complex interaction scenarios, especially from sparse inputs, remain challenging. In this paper, we propose NeuralHOFusion, a neural approach for volumetric human-object capture and rendering using sparse consumer RGBD sensors. It marries traditional non-rigid fusion with recent neural implicit modeling and blending advances, where the captured humans and objects are layerwise disentangled. For geometry modeling, we propose a neural implicit inference scheme with non-rigid key-volume fusion, as well as a template-aid robust object tracking pipeline. Our scheme enables detailed and complete geometry generation under complex interactions and occlusions. Moreover, we introduce a layer-wise human-object texture rendering scheme, which combines volumetric and image-based rendering in both spatial and temporal domains to obtain photo-realistic results. Extensive experiments demonstrate the effectiveness and efficiency of our approach in synthesizing photo-realistic free-view results under complex human-object interactions.


title: A Systematic Literature Review about Idea Mining: The Use of Machine-driven Analytics to Generate Ideas

abstract: Idea generation is the core activity of innovation. Digital data sources, which are sources of innovation, such as patents, publications, social media, websites, etc., are increasingly growing at unprecedented volume. Manual idea generation is time-consuming and is affected by the subjectivity of the individuals involved. Therefore, the use machine-driven data analytics techniques to analyze data to generate ideas and support idea generation by serving users is useful. The objective of this study is to study state-of the-art machine-driven analytics for idea generation and data sources, hence the result of this study will generally server as a guideline for choosing techniques and data sources. A systematic literature review is conducted to identify relevant scholarly literature from IEEE, Scopus, Web of Science and Google Scholar. We selected a total of 71 articles and analyzed them thematically. The results of this study indicate that idea generation through machine-driven analytics applies text mining, information retrieval (IR), artificial intelligence (AI), deep learning, machine learning, statistical techniques, natural language processing (NLP), NLP-based morphological analysis, network analysis, and bibliometric to support idea generation. The results include a list of techniques and procedures in idea generation through machine-driven idea analytics. Additionally, characterization and heuristics used in idea generation are summarized. For the future, tools designed to generate ideas could be explored.


title: On Digital Subcarrier Multiplexing under A Bandwidth Limitation and ASE Noise

abstract: We show that digital subcarrier multiplexing (DSM) systems require much greater complexity for Nyquist pulse shaping than single-carrier (SC) systems, and it is a misconception that both systems use the same bandwidth when using the same pulse shaping. Through back-to-back (B2B) experiments with realistic transmitter (TX) modules and amplified spontaneous emission (ASE) noise loading, we show that even with optimized waterfilling and entropy loading, DSM does not achieve a larger net data rate (NDR) compared to SC when only ASE noise exists in the channel in long-haul transmission scenarios.


title: Hidden symmetry of the static response of black holes: Applications to Love numbers

abstract: We show that any static linear perturbations around Schwarzschild black holes enjoy a set of conserved charges which forms a centrally extended Schr\"{o}dinger algebra sh(1) = sl$(2,\mathbb{R}) \ltimes \mathcal{H}$. The central charge is given by the black hole mass, echoing results on black hole entropy from near-horizon diffeomorphism symmetry. The finite symmetry transformations generated by these conserved charges correspond to Galilean and conformal transformations of the static field and of the coordinates. This new structure allows one to discuss the static response of a Schwarzschild black hole in the test field approximation from a symmetry-based approach. First we show that the (horizontal) symmetry protecting the vanishing of the Love numbers recently exhibited by Hui et al, dubbed the HJPSS symmetry, coincides with one of the sl$(2,\mathbb{R})$ generators of the Schr\"{o}dinger group. Then, it is demonstrated that the HJPSS symmetry is selected thanks to the spontaneous breaking of the full Schr\"{o}dinger symmetry at the horizon down to a simple abelian sub-group. The latter can be understood as the symmetry protecting the regularity of the test field at the horizon. In the 4-dimensional case, this provides a symmetry protection for the vanishing of the Schwarzschild Love numbers. Our results trivially extend to the Kerr case.


title: Convergence of a New Learning Algorithm

abstract: A new learning algorithm proposed by Brandt and Lin for neural network [1], [2] has been shown to be mathematically equivalent to the conventional back-propagation learning algorithm, but has several advantages over the backpropagation algorithm, including feedback-network-free implementation and biological plausibility. In this paper, we investigate the convergence of the new algorithm. A necessary and sufficient condition for the algorithm to converge is derived. A convergence measure is proposed to measure the convergence rate of the new algorithm. Simulation studies are conducted to investigate the convergence of the algorithm with respect to the number of neurons, the connection distance, the connection density, the ratio of excitatory/inhibitory synapses, the membrane potentials, and the synapse strengths.


title: A multi-domain VNE algorithm based on multi-objective optimization for IoD architecture in Industry 4.0

abstract: Unmanned aerial vehicle (UAV) has a broad application prospect in the future, especially in the Industry 4.0. The development of Internet of Drones (IoD) makes UAV operation more autonomous. Network virtualization technology is a promising technology to support IoD, so the allocation of virtual resources becomes a crucial issue in IoD. How to rationally allocate potential material resources has become an urgent problem to be solved. The main work of this paper is presented as follows: (1) In order to improve the optimization performance and reduce the computation time, we propose a multi-domain virtual network embedding algorithm (MP-VNE) adopting the centralized hierarchical multi-domain architecture. The proposed algorithm can avoid the local optimum through incorporating the genetic variation factor into the traditional particle swarm optimization process. (2) In order to simplify the multi-objective optimization problem, we transform the multi-objective problem into a single-objective problem through weighted summation method. The results prove that the proposed algorithm can rapidly converge to the optimal solution. (3) In order to reduce the mapping cost, we propose an algorithm for selecting candidate nodes based on the estimated mapping cost. Each physical domain calculates the estimated mapping cost of all nodes according to the formula of the estimated mapping cost, and chooses the node with the lowest estimated mapping cost as the candidate node. The simulation results show that the proposed MP-VNE algorithm has better performance than MC-VNM, LID-VNE and other algorithms in terms of delay, cost and comprehensive indicators.


title: Benchmark Assessment for DeepSpeed Optimization Library

abstract: Deep Learning (DL) models are widely used in machine learning due to their performance and ability to deal with large datasets while producing high accuracy and performance metrics. The size of such datasets and the complexity of DL models cause such models to be complex, consuming large amount of resources and time to train. Many recent libraries and applications are introduced to deal with DL complexity and efficiency issues. In this paper, we evaluated one example, Microsoft DeepSpeed library through classification tasks. DeepSpeed public sources reported classification performance metrics on the LeNet architecture. We extended this through evaluating the library on several modern neural network architectures, including convolutional neural networks (CNNs) and Vision Transformer (ViT). Results indicated that DeepSpeed, while can make improvements in some of those cases, it has no or negative impact on others.


title: Morphology Without Borders: Clause-Level Morphology

abstract: Morphological tasks use large multi-lingual datasets that organize words into inflection tables, which then serve as training and evaluation data for various tasks. However, a closer inspection of these data reveals profound cross-linguistic inconsistencies, that arise from the lack of a clear linguistic and operational definition of what is a word, and that severely impair the universality of the derived tasks. To overcome this deficiency, we propose to view morphology as a clause-level phenomenon, rather than word-level. It is anchored in a fixed yet inclusive set of features, that encapsulates all functions realized in a saturated clause. We deliver MightyMorph, a novel dataset for clause-level morphology covering 4 typologically-different languages: English, German, Turkish and Hebrew. We use this dataset to derive 3 clause-level morphological tasks: inflection, reinflection and analysis. Our experiments show that the clause-level tasks are substantially harder than the respective word-level tasks, while having comparable complexity across languages. Furthermore, redefining morphology to the clause-level provides a neat interface with contextualized language models (LMs) and allows assessing the morphological knowledge encoded in these models and their usability for morphological tasks. Taken together, this work opens up new horizons in the study of computational morphology, leaving ample space for studying neural morphology cross-linguistically.


title: Inter-Cell Slicing Resource Partitioning via Coordinated Multi-Agent Deep Reinforcement Learning

abstract: Network slicing enables the operator to configure virtual network instances for diverse services with specific requirements. To achieve the slice-aware radio resource scheduling, dynamic slicing resource partitioning is needed to orchestrate multi-cell slice resources and mitigate inter-cell interference. It is, however, challenging to derive the analytical solutions due to the complex inter-cell interdependencies, interslice resource constraints, and service-specific requirements. In this paper, we propose a multi-agent deep reinforcement learning (DRL) approach that improves the max-min slice performance while maintaining the constraints of resource capacity. We design two coordination schemes to allow distributed agents to coordinate and mitigate inter-cell interference. The proposed approach is extensively evaluated in a system-level simulator. The numerical results show that the proposed approach with inter-agent coordination outperforms the centralized approach in terms of delay and convergence. The proposed approach improves more than two-fold increase in resource efficiency as compared to the baseline approach.


title: An ultraweak variational method for parameterized linear differential-algebraic equations

abstract: We investigate an ultraweak variational formulation for (parameterized) linear differential-algebraic equations (DAEs) w.r.t. the time variable which yields an optimally stable system. This is used within a Petrov-Galerkin method to derive a certified detailed discretization which provides an approximate solution in an ultraweak setting as well as for model reduction w.r.t. time in the spirit of the Reduced Basis Method (RBM). A computable sharp error bound is derived. Numerical experiments are presented that show that this method yields a significant reduction and can be combined with well-known system theoretic methods such as Balanced Truncation to reduce the size of the DAE.


title: New low mass ratio contact binaries in the Catalina Sky Survey

abstract: We present the identification and photometric analysis of 30 new low mass ratio (LMR) totally eclipsing contact binaries found in Catalina Sky Survey data. The LMR candidates are identified using Fourier coefficients and visual inspection. We perform a detailed scan in the parameter plane of mass-ratio (q) versus inclination (i) using Phoebe-0.31 scripter to derive the best (q,i) pair for the initial models. The relative physical parameters are determined from the final model of each system. A Monte-Carlo approach was adopted to derive the parameter errors. The resulting parameters confirm the identification. The approximate absolute physical parameters of the systems are estimated based on the light curve solutions and Gaia early Data Release 3 distances. Twelve out of 30 new systems have fill-out factors $f\gt 50 \%$ and $q \leq 0.25$ (deep contact LMR systems), and 8 of them, to within errors, are extreme LMR deep systems with $q\leq0.1$. We discuss the evolutionary status of the 30 LMR systems in comparison with the most updated catalog of LMR systems from the literature. The scenario of the LMR systems as pre-merger candidates forming fast rotating stars is investigated for all systems, new and old, based both on Hut's stability criteria and critical instability mass ratio ($q_{inst}$) relation. CSS$\_$J075848.2+125656, with $\frac{q}{q_{inst}}=1.23\pm 0.23$, and CSS$\_$J093010.1-021624, with $\frac{q}{q_{inst}}=1.25\pm 0.23$, can be considered as merger candidates.


title: Compositional Trends in Surface Enhanced Diffusion in Lead Silicate Glasses

abstract: In this work, we use molecular dynamics simulations to study the enhancement of surface over bulk diffusion (surface enhanced diffusion) in (PbO)x(SiO2)1-x glasses. This work is motivated to better understand surface diffusion in glasses and its connection to fragility, and to enhance surface diffusion in silica and related glasses for greater thermodynamic stability during vapor-deposition. By adding PbO to silica, the fragility of glass increases continuously for 10% <= x <= 70% during experiments. The increase in fragility may correspond to an increase in surface enhanced diffusion, as fragility and surface diffusion are correlated. We observe that for the silicates investigated, while surface enhanced diffusion increases with fragility, the enhancement is quite small. The slower diffusing Si and O atoms have higher enhancements, which could allow for some surface stabilization effects. We demonstrate that there are only small changes in atomic arrangements, consistent with the similar diffusion rates, at the surface as compared to bulk. Finally, we examine the trend of bulk versus surface diffusion in view of previous observations in organic and metallic glasses and found that in oxides, fragility increase may not be strongly linked to enhanced surface diffusion.


title: Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

abstract: Large language models (LMs) are able to in-context learn -- perform a new task via inference alone by conditioning on a few input-label pairs (demonstrations) and making predictions for new inputs. However, there has been little understanding of how the model learns and which aspects of the demonstrations contribute to end task performance. In this paper, we show that ground truth demonstrations are in fact not required -- randomly replacing labels in the demonstrations barely hurts performance on a range of classification and multi-choce tasks, consistently over 12 different models including GPT-3. Instead, we find that other aspects of the demonstrations are the key drivers of end task performance, including the fact that they provide a few examples of (1) the label space, (2) the distribution of the input text, and (3) the overall format of the sequence. Together, our analysis provides a new way of understanding how and why in-context learning works, while opening up new questions about how much can be learned from large language models through inference alone.


title: RelMobNet: End-to-end relative camera pose estimation using a robust two-stage training

abstract: Relative camera pose estimation, i.e. estimating the translation and rotation vectors using a pair of images taken in different locations, is an important part of systems in augmented reality and robotics. In this paper, we present an end-to-end relative camera pose estimation network using a siamese architecture that is independent of camera parameters. The network is trained using the Cambridge Landmarks data with four individual scene datasets and a dataset combining the four scenes. To improve generalization, we propose a novel two-stage training that alleviates the need of a hyperparameter to balance the translation and rotation loss scale. The proposed method is compared with one-stage training CNN-based methods such as RPNet and RCPNet and demonstrate that the proposed model improves translation vector estimation by 16.11%, 28.88%, and 52.27% on the Kings College, Old Hospital, and St Marys Church scenes, respectively. For proving texture invariance, we investigate the generalization of the proposed method augmenting the datasets to different scene styles, as ablation studies, using generative adversarial networks. Also, we present a qualitative assessment of epipolar lines of our network predictions and ground truth poses.


title: Theia: Summary of physics program. Snowmass White Paper Submission

abstract: Theia would be a novel, "hybrid" optical neutrino detector, with a rich physics program. This paper is intended to provide a brief overview of the concepts and physics reach of Theia. Full details can be found in the Theia white paper [1].


title: On stable type IIA de-Sitter vacua with geometric flux

abstract: We present a class of tachyon-free (stable) AdS as well as dS solutions in the context of type IIA orientifold compactifications. This model is based on a type IIA setting having geometric flux which, in addition, also includes the usual NS-NS three-form flux ${\rm H}_3$ and the RR $p$-form fluxes ${\rm F}_p$ for $p \in \{0, 2, 4, 6\}$. Although all the saxionic moduli are stabilized, there remains a combination of the RR axions which is flat, and the dS solution is realized through the $D$-term effects induced by the geometric fluxes, without which one can only have AdS solutions. Using flux scaling arguments we also discuss how to engineer a parametric control in these models, in the sense of realizing the respective AdS/dS solutions in large volume, weak string-coupling as well as large complex-structure regime. We also discuss open possibilities (e.g. about the unknown status on having the complete set of Bianchi identities) under which such tachyon-free dS solutions may or may not be viable.


title: A lower limit for Newtonian-noise models of the Einstein Telescope

abstract: The Einstein Telescope (ET) is a proposed third-generation gravitational-wave (GW) underground observatory. It will have greatly increased sensitivity compared to current GW detectors, and it is designed to extend the observation band down to a few Hz. At these frequencies, a major limitation of the ET sensitivity is predicted to be due to gravitational fluctuations produced by the environment, most importantly by the seismic field, which give rise to the so-called Newtonian noise (NN). Accurate models of ET NN are crucial to assess the compatibility of an ET candidate site with the ET sensitivity target also considering a possible reduction of NN by noise cancellation. With NN models becoming increasingly complex as they include details of geology and topography, it is crucial to have tools to make robust assessments of their accuracy. For this purpose, we derive a lower bound on seismic NN spectra, which is weakly dependent on geology and properties of the seismic field. As a first application, we use the lower limit to compare it with NN estimates recently calculated for the Sardinia and Euregio Meuse-Rhine (EMR) candidate sites. We find the utility of the method, which shows an inconsistency with the predictions for the EMR site, which indicates that ET NN models require further improvement.


title: Perturbative renormalization and thermodynamics of quantum crystalline membranes

abstract: We analyze the statistical mechanics of a free-standing quantum crystalline membrane within the framework of a systematic perturbative renormalization group (RG). A power-counting analysis shows that the leading singularities of correlation functions can be analyzed within an effective renormalizable model in which the kinetic energy of in-plane phonons and subleading geometrical nonlinearities in the expansion of the strain tensor are neglected. For membranes at zero temperature, governed by zero-point motion, the RG equations of the effective model provide a systematic derivation of logarithmic corrections to the bending rigidity and to the elastic Young modulus derived in earlier investigations. In the limit of a weakly applied external tension, the stress-strain relation at $T = 0$ is anomalous: the linear Hooke's law is replaced with a singular law exhibiting logarithmic corrections. For small, but finite temperatures, we use techniques of finite-size scaling to derive general relations between the zero-temperature RG flow and scaling laws of thermodynamic quantities such as the thermal expansion coefficient $\alpha$, the entropy S, and the specific heat C. A combination of the scaling relations with an analysis of thermal fluctuations shows that, for small temperatures, the thermal expansion coefficient $\alpha$ is negative and logarithmically dependent on $T$, as predicted in an earlier work. Although the requirement $\lim_{T \to 0} \alpha = 0$, expected from the third law of thermodynamics is formally satisfied, $\alpha$ is predicted to exhibit such a slow variation to remain practically constant down to unaccessibly small temperatures.


title: Dynamic Regret of Online Mirror Descent for Relatively Smooth Convex Cost Functions

abstract: The performance of online convex optimization algorithms in a dynamic environment is often expressed in terms of the dynamic regret, which measures the decision maker's performance against a sequence of time-varying comparators. In the analysis of the dynamic regret, prior works often assume Lipschitz continuity or uniform smoothness of the cost functions. However, there are many important cost functions in practice that do not satisfy these conditions. In such cases, prior analyses are not applicable and fail to guarantee the optimization performance. In this letter, we show that it is possible to bound the dynamic regret, even when neither Lipschitz continuity nor uniform smoothness is present. We adopt the notion of relative smoothness with respect to some user-defined regularization function, which is a much milder requirement on the cost functions. We first show that under relative smoothness, the dynamic regret has an upper bound based on the path length and functional variation. We then show that with an additional condition of relatively strong convexity, the dynamic regret can be bounded by the path length and gradient variation. These regret bounds provide performance guarantees to a wide variety of online optimization problems that arise in different application domains. Finally, we present numerical experiments that demonstrate the advantage of adopting a regularization function under which the cost functions are relatively smooth.


title: Individual Fairness in Feature-Based Pricing for Monopoly Markets

abstract: We study fairness in the context of feature-based price discrimination in monopoly markets. We propose a new notion of individual fairness, namely, \alpha-fairness, which guarantees that individuals with similar features face similar prices. First, we study discrete valuation space and give an analytical solution for optimal fair feature-based pricing. We show that the cost of fair pricing is defined as the ratio of expected revenue in an optimal feature-based pricing to the expected revenue in an optimal fair feature-based pricing (CoF) can be arbitrarily large in general. When the revenue function is continuous and concave with respect to the prices, we show that one can achieve CoF strictly less than 2, irrespective of the model parameters. Finally, we provide an algorithm to compute fair feature-based pricing strategy that achieves this CoF.


title: Neutron stars and phase diagram in a hard-wall AdS/QCD model

abstract: We study the phase diagram of (large-$N_c$) QCD using a simplistic holographic hard-wall model with a dynamical scalar field and a homogeneous Ansatz representing a smeared instanton/baryon density. The resulting phase diagram is qualitatively consistent with expectations, including a mesonic, baryonic, quarkyonic, and quark-gluon plasma phase. As in other holographic models, we also find a baryonic popcorn transition, which appears at large chemical potential as a crossover. We then evaluate the nuclear matter equation of state, which turns out to be rather stiff with a large peaked sound velocity above the conformal limit, construct corresponding neutron stars using the TOV equations, and finally use a full numerical gravity/hydrodynamics computation to extract the gravitational wave signal of neutron star mergers.


title: An initial alignment between neural network and target is needed for gradient descent to learn

abstract: This paper introduces the notion of ``Initial Alignment'' (INAL) between a neural network at initialization and a target function. It is proved that if a network and a Boolean target function do not have a noticeable INAL, then noisy gradient descent on a fully connected network with normalized i.i.d. initialization will not learn in polynomial time. Thus a certain amount of knowledge about the target (measured by the INAL) is needed in the architecture design. This also provides an answer to an open problem posed in [AS20]. The results are based on deriving lower-bounds for descent algorithms on symmetric neural networks without explicit knowledge of the target function beyond its INAL.


title: Building a 3-Player Mahjong AI using Deep Reinforcement Learning

abstract: Mahjong is a popular multi-player imperfect-information game developed in China in the late 19th-century, with some very challenging features for AI research. Sanma, being a 3-player variant of the Japanese Riichi Mahjong, possesses unique characteristics including fewer tiles and, consequently, a more aggressive playing style. It is thus challenging and of great research interest in its own right, but has not yet been explored. In this paper, we present Meowjong, an AI for Sanma using deep reinforcement learning. We define an informative and compact 2-dimensional data structure for encoding the observable information in a Sanma game. We pre-train 5 convolutional neural networks (CNNs) for Sanma's 5 actions -- discard, Pon, Kan, Kita and Riichi, and enhance the major action's model, namely the discard model, via self-play reinforcement learning using the Monte Carlo policy gradient method. Meowjong's models achieve test accuracies comparable with AIs for 4-player Mahjong through supervised learning, and gain a significant further enhancement from reinforcement learning. Being the first ever AI in Sanma, we claim that Meowjong stands as a state-of-the-art in this game.


title: A Robust Multi-Objective Bayesian Optimization Framework Considering Input Uncertainty

abstract: Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as input uncertainty into account to find a set of robust solutions. While this is an active topic in single-objective Bayesian optimization, it is less investigated in the multi-objective case. We introduce a novel Bayesian optimization framework to efficiently perform multi-objective optimization considering input uncertainty. We propose a robust Gaussian Process model to infer the Bayes risk criterion to quantify robustness, and we develop a two-stage Bayesian optimization process to search for a robust Pareto frontier. The complete framework supports various distributions of the input uncertainty and takes full advantage of parallel computing. We demonstrate the effectiveness of the framework through numerical benchmarks.


title: Witness Generation for JSON Schema

abstract: JSON Schema is an important, evolving standard schema language for families of JSON documents. It is based on a complex combination of structural and Boolean assertions, and features negation and recursion. The static analysis of JSON Schema documents comprises practically relevant problems, including schema satisfiability, inclusion, and equivalence. These three problems can be reduced to witness generation: given a schema, generate an element of the schema, if it exists, and report failure otherwise. Schema satisfiability, inclusion, and equivalence have been shown to be decidable, by reduction to reachability in alternating tree automata. However, no witness generation algorithm has yet been formally described. We contribute a first, direct algorithm for JSON Schema witness generation. We study its effectiveness and efficiency, in experiments over several schema collections, including thousands of real-world schemas. Our focus is on the completeness of the language, where we only exclude the uniqueItems operator, and on the ability of the algorithm to run in a reasonable time on a large set of real-world examples, despite the exponential complexity of the underlying problem.


title: Crystal Melting, BPS Quivers and Plethystics

abstract: We study the refined and unrefined crystal/BPS partition functions of D6-D2-D0 brane bound states for all toric Calabi-Yau threefolds without compact 4-cycles and some non-toric examples. They can be written as products of (generalized) MacMahon functions. We check our expressions and use them as vacuum characters to study the gluings. We then consider the wall crossings and discuss possible crystal descriptions for different chambers. We also express the partition functions in terms of plethystic exponentials. For $\mathbb{C}^3$ and tripled affine quivers, we find their connections to nilpotent Kac polynomials. Similarly, the partition functions of D4-D2-D0 brane bound states can be obtained by replacing the (generalized) MacMahon functions with the inverse of (generalized) Euler functions.


title: Boosting Distributional Copula Regression

abstract: Capturing complex dependence structures between outcome variables (e.g., study endpoints) is of high relevance in contemporary biomedical data problems and medical research. Distributional copula regression provides a flexible tool to model the joint distribution of multiple outcome variables by disentangling the marginal response distributions and their dependence structure. In a regression setup each parameter of the copula model, i.e. the marginal distribution parameters and the copula dependence parameters, can be related to covariates via structured additive predictors. We propose a framework to fit distributional copula regression models via a model-based boosting algorithm. Model-based boosting is a modern estimation technique that incorporates useful features like an intrinsic variable selection mechanism, parameter shrinkage and the capability to fit regression models in high dimensional data setting, i.e. situations with more covariates than observations. Thus, model-based boosting does not only complement existing Bayesian and maximum-likelihood based estimation frameworks for this model class but rather enables unique intrinsic mechanisms that can be helpful in many applied problems. The performance of our boosting algorithm in the context of copula regression models with continuous margins is evaluated in simulation studies that cover low- and high-dimensional data settings and situations with and without dependence between the responses. Moreover, distributional copula boosting is used to jointly analyze and predict the length and the weight of newborns conditional on sonographic measurements of the fetus before delivery together with other clinical variables.


title: A CNN-based Post-Processor for Perceptually-Optimized Immersive Media Compression

abstract: In recent years, resolution adaptation based on deep neural networks has enabled significant performance gains for conventional (2D) video codecs. This paper investigates the effectiveness of spatial resolution resampling in the context of immersive content. The proposed approach reduces the spatial resolution of input multi-view videos before encoding, and reconstructs their original resolution after decoding. During the up-sampling process, an advanced CNN model is used to reduce potential re-sampling, compression, and synthesis artifacts. This work has been fully tested with the TMIV coding standard using a Versatile Video Coding (VVC) codec. The results demonstrate that the proposed method achieves a significant rate-quality performance improvement for the majority of the test sequences, with an average BD-VMAF improvement of 3.07 overall sequences.


title: Physically-informed data-driven modeling of active nematics

abstract: A continuum description is essential for understanding a variety of collective phenomena in active matter. However, building quantitative continuum models of active matter from first principles can be extremely challenging due to both the gaps in our knowledge and the complicated structure of nonlinear interactions. Here we use a novel physically-informed data-driven approach to construct a complete mathematical model of an active nematic from experimental data describing kinesin-driven microtubule bundles confined to an oil-water interface. We find that the structure of the model is similar to the Leslie-Ericksen and Beris-Edwards models, but there are significant and important differences. Rather unexpectedly, elastic effects are found to play no role in the experiments considered, with the dynamics controlled entirely by the balance between active stresses and friction stresses.


title: Data-driven discovery of active nematic hydrodynamics

abstract: Two-dimensional active nematics are often modeled using phenomenological continuum theories that describe the dynamics of the nematic director and fluid velocity through partial differential equations (PDEs). While these models provide a statistically accurate description of the experiments, the identification of the relevant terms in the PDEs and their parameters is usually indirect. Here, we adapt a recently developed method to automatically identify optimal continuum models for active nematics directly from the spatio-temporal director and velocity data, via sparse fitting of the coarse-grained fields onto generic low order PDEs. We test the method extensively on computational models, and then apply it to data from experiments on microtubule-based active nematics. Thereby, we identify the optimal models for microtubule-based active nematics, along with the relevant phenomenological parameters. We find that the dynamics of the orientation field are largely governed by its coupling to the underlying flow, with free-energy gradients playing a negligible role. Furthermore, by fitting the flow equation to experimental data, we estimate a key parameter quantifying the `activity' of the nematic.