title: CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes

abstract: Continuity of care is crucial to ensuring positive health outcomes for patients discharged from an inpatient hospital setting, and improved information sharing can help. To share information, caregivers write discharge notes containing action items to share with patients and their future caregivers, but these action items are easily lost due to the lengthiness of the documents. In this work, we describe our creation of a dataset of clinical action items annotated over MIMIC-III, the largest publicly available dataset of real clinical notes. This dataset, which we call CLIP, is annotated by physicians and covers 718 documents representing 100K sentences. We describe the task of extracting the action items from these documents as multi-aspect extractive summarization, with each aspect representing a type of action to be taken. We evaluate several machine learning models on this task, and show that the best models exploit in-domain language model pre-training on 59K unannotated documents, and incorporate context from neighboring sentences. We also propose an approach to pre-training data selection that allows us to explore the trade-off between size and domain-specificity of pre-training datasets for this task.


title: Impact of Multiplicity Fluctuations on Entropy Scaling Across System Size

abstract: The initial state is one of the greatest uncertainties in heavy-ion collisions. A model-agnostic approach is taken in the phenomenological Trento framework which constrains parameters using Bayesian analysis. However, the color-glass condensate (CGC) effective theory predicts initial energy densities that lie outside the recent Bayesian analyses due, in part, to the assumption in Trento of event-by-event multiplicity fluctuations following a $\Gamma$ distribution. We compare the Trento-preferred $\sqrt{T_{A}T_{B}}$ scaling to CGC-like $T_{A}T_{B}$ scaling coupled with log-normal fluctuations in $AuAu$ and $dAu$ collisions and find there is a significant impact on the multiplicity distributions and on the eccentricities, which may affect the extraction of viscosity in small systems.


title: Constraining Ultra Light Dark Matter with the Galactic Nuclear Star Cluster

abstract: We use the Milky Way's nuclear star cluster (NSC) to test the existence of a dark matter 'soliton core', as predicted in ultra-light dark matter (ULDM) models. Since the soliton core size is proportional to mDM^{-1}, while the core density grows as mDM^{2}, the NSC (dominant stellar component within about 3 pc) is sensitive to a specific window in the dark matter particle mass, mDM. We apply a spherical isotropic Jeans model to fit the NSC line-of-sight velocity dispersion data, assuming priors on the precisely measured Milky Way's supermassive black hole (SMBH) mass and the well-measured NSC density profile. We find that the current observational data reject the existence of a soliton core for a single ULDM particle with mass in the range 10^{-20.4} < mDM < 10^{-18.5} eV, assuming that the soliton core structure is not affected by the Milky Way's SMBH. We test our methodology on mock data, confirming that we are sensitive to the same range in ULDM mass as for the real data. Dynamical modelling of a larger region of the Galactic centre, including the nuclear stellar disc, promises tighter constraints over a broader range of mDM. We will consider this in future work.


title: RoadMap: A Light-Weight Semantic Map for Visual Localization towards Autonomous Driving

abstract: Accurate localization is of crucial importance for autonomous driving tasks. Nowadays, we have seen a lot of sensor-rich vehicles (e.g. Robo-taxi) driving on the street autonomously, which rely on high-accurate sensors (e.g. Lidar and RTK GPS) and high-resolution map. However, low-cost production cars cannot afford such high expenses on sensors and maps. How to reduce costs? How do sensor-rich vehicles benefit low-cost cars? In this paper, we proposed a light-weight localization solution, which relies on low-cost cameras and compact visual semantic maps. The map is easily produced and updated by sensor-rich vehicles in a crowd-sourced way. Specifically, the map consists of several semantic elements, such as lane line, crosswalk, ground sign, and stop line on the road surface. We introduce the whole framework of on-vehicle mapping, on-cloud maintenance, and user-end localization. The map data is collected and preprocessed on vehicles. Then, the crowd-sourced data is uploaded to a cloud server. The mass data from multiple vehicles are merged on the cloud so that the semantic map is updated in time. Finally, the semantic map is compressed and distributed to production cars, which use this map for localization. We validate the performance of the proposed map in real-world experiments and compare it against other algorithms. The average size of the semantic map is $36$ kb/km. We highlight that this framework is a reliable and practical localization solution for autonomous driving.


title: Neural Network Surrogate Models for Absorptivity and Emissivity Spectra of Multiple Elements

abstract: Simulations of high energy density physics are expensive in terms of computational resources. In particular, the computation of opacities of plasmas in the non-local thermal equilibrium (NLTE) regime can consume as much as 90\% of the total computational time of radiation hydrodynamics simulations for high energy density physics applications. Previous work has demonstrated that a combination of fully-connected autoencoders and a deep jointly-informed neural network (DJINN) can successfully replace the standard NLTE calculations for the opacity of krypton. This work expands this idea to combining multiple elements into a single surrogate model with the focus here being on the autoencoder.


title: Blockchain for Transactive Energy Management of Distributed Energy Resources in Smart Grid

abstract: This work presents the design and implementation of a blockchain system that enables the trustable transactive energy management for distributed energy resources (DERs). We model the interactions among DERs, including energy trading and flexible appliance scheduling, as a cost minimization problem. Considering the dispersed nature and diverse ownership of DERs, we develop a distributed algorithm to solve the optimization problem using the alternating direction method of multipliers (ADMM) method. Furthermore, we develop a blockchain system, on which we implement the proposed algorithm with the smart contract, to guarantee the transparency and correctness of the energy management. We prototype the blockchain in a small-scale test network and evaluate it through experiments using real-world data. The experimental results validate the feasibility and effectiveness of our design.


title: A long-lived solid-state optical quantum memory for high-rate quantum repeaters

abstract: We argue that long optical storage times are required to establish entanglement at high rates over large distances using memory-based quantum repeaters. Triggered by this conclusion, we investigate the $^3$H$_6$ $\leftrightarrow$ $^3$H$_4$ transition at 795.325 nm of Tm:Y$_3$Ga$_5$O$_{12}$ (Tm:YGG). Most importantly, we show that the optical coherence time can reach 1.1 ms, and, using laser pulses, we demonstrate optical storage based on the atomic frequency comb protocol up to 100 $\mu$s as well as a memory decay time T$_M$ of 13.1 $\mu$s. Possibilities of how to narrow the gap between the measured value of T$_m$ and its maximum of 275 $\mu$s are discussed. In addition, we demonstrate quantum state storage using members of non-classical photon pairs. Our results show the potential of Tm:YGG for creating quantum memories with long optical storage times, and open the path to building extended quantum networks.


title: CAFLOW: Conditional Autoregressive Flows

abstract: We introduce CAFLOW, a new diverse image-to-image translation model that simultaneously leverages the power of auto-regressive modeling and the modeling efficiency of conditional normalizing flows. We transform the conditioning image into a sequence of latent encodings using a multi-scale normalizing flow and repeat the process for the conditioned image. We model the conditional distribution of the latent encodings by modeling the auto-regressive distributions with an efficient multi-scale normalizing flow, where each conditioning factor affects image synthesis at its respective resolution scale. Our proposed framework performs well on a range of image-to-image translation tasks. It outperforms former designs of conditional flows because of its expressive auto-regressive structure.


title: Hints of FLRW Breakdown from Supernovae

abstract: A 10\% difference in the scale for the Hubble parameter constitutes a clear problem for cosmology. Here, considering angular distribution of Type Ia supernovae (SN) within the Pantheon compilation and working within flat $\Lambda$CDM cosmology, we observe a correlation between higher $H_0$ and the CMB dipole direction, confirming our previous results for strongly-lensed quasars \cite{Krishnan:2021dyb}. Concretely, we record a $\sim 1$ km/s/Mpc variation in $H_0$ at antipodal points on the sky within the Pantheon sample, which is evident in the Low $z$ subsample ($z \lesssim 0.075$) and gets enhanced by higher redshift SN. Our work raises the possibility that we may be at the precision required to probe anisotropic Hubble expansions, while providing a concrete prediction for future inferences of $H_0$.


title: Graph-based Deep Learning for Communication Networks: A Survey

abstract: Communication networks are important infrastructures in contemporary society. There are still many challenges that are not fully solved and new solutions are proposed continuously in this active research area. In recent years, to model the network topology, graph-based deep learning has achieved the state-of-the-art performance in a series of problems in communication networks. In this survey, we review the rapidly growing body of research using different graph-based deep learning models, e.g. graph convolutional and graph attention networks, in various problems from different types of communication networks, e.g. wireless networks, wired networks, and software defined networks. We also present a well-organized list of the problem and solution for each study and identify future research directions. To the best of our knowledge, this paper is the first survey that focuses on the application of graph-based deep learning methods in communication networks involving both wired and wireless scenarios. To track the follow-up research, a public GitHub repository is created, where the relevant papers will be updated continuously.


title: Cyclic Pattern Containment and Avoidance

abstract: The study of pattern containment and avoidance for linear permutations is a well-established area of enumerative combinatorics. A cyclic permutation is the set of all rotations of a linear permutation. Callan initiated the study of permutation avoidance in cyclic permutations and characterized the avoidance classes for all single permutations of length 4. We continue this work. In particular, we establish a cyclic variant of the Erdos-Szekeres Theorem that any linear permutation of length mn+1 must contain either the increasing pattern of length m+1 or the decreasing pattern of length n+1. We then derive results about avoidance of multiple patterns of length 4. We also determine generating functions for the cyclic descent statistic on these classes. Finally, we end with various open questions and avenues for future research.


title: Flying with Cartographer: Adapting the Cartographer 3D Graph SLAM Stack for UAV Navigation

abstract: This paper describes an application of the Cartographer graph SLAM stack as a pose sensor in a UAV feedback control loop, with certain application-specific changes in the SLAM stack such as smoothing of the optimized pose. Pose estimation is performed by fusing 3D LiDAR/IMU-based proprioception with GPS position measurements by means of pose graph optimisation. Moreover, partial environment maps built from the LiDAR data (submaps) within the Cartographer SLAM stack are marshalled into OctoMap, an Octree-based voxel map implementation. The OctoMap is further used for navigation tasks such as path planning and obstacle avoidance.


title: The Penrose Property with a Cosmological Constant

abstract: A spacetime satisfies the non-timelike boundary version of the Penrose property if the timelike future of any point on $\mathcal{I}^-$ contains the whole of $\mathcal{I}^+$. This property was first discussed for asymptotically flat spacetimes by Penrose, along with an equivalent definition (the finite version). In this paper we consider the Penrose property in greater generality. In particular we consider spacetimes with a non-zero cosmological constant and we note that the two versions of the property are no longer equivalent. In asymptotically AdS spacetimes it is necessary to re-state the property in a way which is more suited to spacetimes with a timelike boundary. We arrive at a property previously considered by Gao and Wald. Curiously, this property was shown to fail in spacetimes which focus null geodesics. This is in contrast to our findings in asymptotically flat and asymptotically de Sitter spacetimes. We then move on to consider some further example spacetimes (with zero cosmological constant) which highlight features of the Penrose property not previously considered. We discuss spacetimes which are the product of a Lorentzian and a compact Riemannian manifold. Perhaps surprisingly, we find that both versions of the Penrose property are satisfied in this product spacetime if and only if they are satisfied in the Lorentzian spacetime only. We also discuss the Ellis-Bronnikov wormhole (an example of a spacetime with more than one asymptotically flat end) and the Hayward metric (an example of a non-singular black hole spacetime).


title: Bounding nonminimality and a conjecture of Borovik-Cherlin

abstract: Motivated by the search for methods to establish strong minimality of certain low order algebraic differential equations, a measure of how far a finite rank stationary type is from being minimal is introduced and studied: The {\em degree of nonminimality} is the minimum number of realisations of the type required to witness a nonalgebraic forking extension. Conditional on the truth of a conjecture of Borovik and Cherlin on the generic multiple-transitivity of homogeneous spaces definable in the stable theory being considered, it is shown that the nonminimality degree is bounded by the $U$-rank plus $2$. The Borovik-Cherlin conjecture itself is verified for algebraic and meromorphic group actions, and a bound of $U$-rank plus $1$ is then deduced unconditionally for differentially closed fields and compact complex manifolds. An application is given regarding transcendence of solutions to algebraic differential equations.


title: Bottleneck Profiles and Discrete Prokhorov Metrics for Persistence Diagrams

abstract: In topological data analysis (TDA), persistence diagrams have been a succesful tool. To compare them, Wasserstein and Bottleneck distances are commonly used. We address the shortcomings of these metrics and show a way to investigate them in a systematic way by introducing bottleneck profiles. This leads to a notion of discrete Prokhorov metrics for persistence diagrams as a generalization of the Bottleneck distance. They satisfy a stability result and bounds with respect to Wasserstein metrics. We provide algorithms to compute the newly introduced quantities and end with an discussion about experiments.


title: Quantum critical systems with dissipative boundaries

abstract: We study the effects of dissipative boundaries in many-body systems at continuous quantum transitions, when the parameters of the Hamiltonian driving the unitary dynamics are close to their critical values. As paradigmatic models, we consider fermionic wires subject to dissipative interactions at the boundaries, associated with pumping or loss of particles. They are induced by couplings with a Markovian baths, so that the evolution of the system density matrix can be described by a Lindblad master equation. We study the quantum evolution arising from variations of the Hamiltonian and dissipation parameters, starting at t=0 from the ground state of the critical Hamiltonian. Two different dynamic regimes emerge: (i) an early-time regime for times t ~ L, where the competition between coherent and incoherent drivings develops a dynamic finite-size scaling, obtained by extending the scaling framework describing the coherent critical dynamics of the closed system, to allow for the boundary dissipation; (ii) a large-time regime for t ~ L^3 whose dynamic scaling describes the late quantum evolution leading to the t->infty stationary states.


title: Transferable and Distributed User Association Policies for 5G and Beyond Networks

abstract: We study the problem of user association, namely finding the optimal assignment of user equipment to base stations to achieve a targeted network performance. In this paper, we focus on the knowledge transferability of association policies. Indeed, traditional non-trivial user association schemes are often scenario-specific or deployment-specific and require a policy re-design or re-learning when the number or the position of the users change. In contrast, transferability allows to apply a single user association policy, devised for a specific scenario, to other distinct user deployments, without needing a substantial re-learning or re-design phase and considerably reducing its computational and management complexity. To achieve transferability, we first cast user association as a multi-agent reinforcement learning problem. Then, based on a neural attention mechanism that we specifically conceived for this context, we propose a novel distributed policy network architecture, which is transferable among users with zero-shot generalization capability i.e., without requiring additional training.Numerical results show the effectiveness of our solution in terms of overall network communication rate, outperforming centralized benchmarks even when the number of users doubles with respect to the initial training point.


title: Free-by-cyclic groups, automorphisms and actions on nearly canonical trees

abstract: We study the automorphism groups of free-by-cyclic groups and show these are finitely generated in the following cases: (i) when defining automorphism has linear growth and (ii) when the rank of the underlying free group has rank at most 3. The techniques we use are actions on trees, including the trees of cylinders due to Guirardel and Levitt, the relative hyperbolicity of free-by-cyclic groups (due to Gautero and Lustig, Ghosh, and Dahmani and Li) and the filtration of the automorphisms of a group preserving a tree, following Bass and Jiang, and Levitt. Our general strategy is to produce an invariant tree for the group and study that, usually reducing the initial problem to some sort of McCool problem (the study of an automorphism group fixing some collection of conjugacy classes of subgroups) for a group of lower complexity. The obstruction to pushing these techniques further, inductively, is in finding a suitable invariant tree and in showing that the relevant McCool groups are finitely generated.


title: Heterogeneous Wasserstein Discrepancy for Incomparable Distributions

abstract: Optimal Transport (OT) metrics allow for defining discrepancies between two probability measures. Wasserstein distance is for longer the celebrated OT-distance frequently-used in the literature, which seeks probability distributions to be supported on the $\textit{same}$ metric space. Because of its high computational complexity, several approximate Wasserstein distances have been proposed based on entropy regularization or on slicing, and one-dimensional Wassserstein computation. In this paper, we propose a novel extension of Wasserstein distance to compare two incomparable distributions, that hinges on the idea of $\textit{distributional slicing}$, embeddings, and on computing the closed-form Wassertein distance between the sliced distributions. We provide a theoretical analysis of this new divergence, called $\textit{heterogeneous Wasserstein discrepancy (HWD)}$, and we show that it preserves several interesting properties including rotation-invariance. We show that the embeddings involved in HWD can be efficiently learned. Finally, we provide a large set of experiments illustrating the behavior of HWD as a divergence in the context of generative modeling and in query framework.


title: Accelerating Dynamical System Simulations with Contracting and Physics-Projected Neural-Newton Solvers

abstract: Recent advances in deep learning have allowed neural networks (NNs) to successfully replace traditional numerical solvers in many applications, thus enabling impressive computing gains. One such application is time domain simulation, which is indispensable for the design, analysis and operation of many engineering systems. Simulating dynamical systems with implicit Newton-based solvers is a computationally heavy task, as it requires the solution of a parameterized system of differential and algebraic equations at each time step. A variety of NN-based methodologies have been shown to successfully approximate the trajectories computed by numerical solvers at a fraction of the time. However, few previous works have used NNs to model the numerical solver itself. For the express purpose of accelerating time domain simulation speeds, this paper proposes and explores two complementary alternatives for modeling numerical solvers. First, we use a NN to mimic the linear transformation provided by the inverse Jacobian in a single Newton step. Using this procedure, we evaluate and project the exact, physics-based residual error onto the NN mapping, thus leaving physics ``in the loop''. The resulting tool, termed the Physics-pRojected Neural-Newton Solver (PRoNNS), is able to achieve an extremely high degree of numerical accuracy at speeds which were observed to be up to 31% faster than a Newton-based solver. In the second approach, we model the Newton solver at the heart of an implicit Runge-Kutta integrator as a contracting map iteratively seeking a fixed point on a time domain trajectory. The associated recurrent NN simulation tool, termed the Contracting Neural-Newton Solver (CoNNS), is embedded with training constraints (via CVXPY Layers) which guarantee the mapping provided by the NN satisfies the Banach fixed-point theorem.


title: On the branching convolution equation $\mathcal E = \mathcal{Z} \circledast \mathcal E$

abstract: We characterize all random point measures which are in a certain sense stable under the action of branching. Denoting by $\circledast$ the branching convolution operation introduced by Bertoin and Mallein (2019), and by $\mathcal{Z}$ the law of a random point measure on the real line, we are interested in solutions to the fixed point equation \[ \mathcal E = \mathcal{Z} \circledast \mathcal E, \] with $\mathcal E$ a random point measure distribution. Under suitable assumptions, we characterize all solutions of this equation as shifted decorated Poisson point processes with a uniquely defined shift.


title: New Insights into Metric Optimization for Ranking-based Recommendation

abstract: Direct optimization of IR metrics has often been adopted as an approach to devise and develop ranking-based recommender systems. Most methods following this approach aim at optimizing the same metric being used for evaluation, under the assumption that this will lead to the best performance. A number of studies of this practice bring this assumption, however, into question. In this paper, we dig deeper into this issue in order to learn more about the effects of the choice of the metric to optimize on the performance of a ranking-based recommender system. We present an extensive experimental study conducted on different datasets in both pairwise and listwise learning-to-rank scenarios, to compare the relative merit of four popular IR metrics, namely RR, AP, nDCG and RBP, when used for optimization and assessment of recommender systems in various combinations. For the first three, we follow the practice of loss function formulation available in literature. For the fourth one, we propose novel loss functions inspired by RBP for both the pairwise and listwise scenario. Our results confirm that the best performance is indeed not necessarily achieved when optimizing the same metric being used for evaluation. In fact, we find that RBP-inspired losses perform at least as well as other metrics in a consistent way, and offer clear benefits in several cases. Interesting to see is that RBP-inspired losses, while improving the recommendation performance for all uses, may lead to an individual performance gain that is correlated with the activity level of a user in interacting with items. The more active the users, the more they benefit. Overall, our results challenge the assumption behind the current research practice of optimizing and evaluating the same metric, and point to RBP-based optimization instead as a promising alternative when learning to rank in the recommendation context.


title: Testing the Goodwin Growth Cycles with Econophysics Approach in 2002-2019 Period in Turkey

abstract: The Turkish economy between 2002-2019 period has been investigated within the econophysical approach. From the individual income data obtained from the Household Budget Survey, the Gompertz-Pareto distribution for each year and Goodwin cycle for the mentioned period have been obtained. For this period, in which thirteen elections were held under the single-party rule, it has been observed that the income distribution fits well with the Gompertz-Pareto distribution which shows the two-class structure of the Turkish economy. The variation of the threshold value $x_t$ (which separates these two classes) as well as Pareto coefficient have been obtained. Besides, Goodwin cycle has been observed within this period, centered at $(u,v)\cong (66.30,83.40)$ and a period of $T=18.30$ years. It has been concluded that these observations are consistent with the economic and social events experienced in the mentioned period.


title: Flux recovery for Cut finite element method and its application in a posteriori error estimation

abstract: In this article, we aim to recover locally conservative and $H(div)$ conforming fluxes for the linear Cut Finite Element Solution with Nitsche's method for Poisson problems with Dirichlet boundary condition. The computation of the conservative flux in the Raviart-Thomas space is completely local and does not require to solve any mixed problem. The $L^2$-norm of the difference between the numerical flux and the recovered flux can then be used as a posteriori error estimator in the adaptive mesh refinement procedure. Theoretically we are able to prove the global reliability and local efficiency. The theoretical results are verified in the numerical results. Moreover, in the numerical results we also observe optimal convergence rate for the flux error.


title: Coordination problems on networks revisited: statics and dynamics

abstract: Simple binary-state coordination models are widely used to study collective socio-economic phenomena such as the spread of innovations or the adoption of products on social networks. The common trait of these systems is the occurrence of large-scale coordination events taking place abruptly, in the form of a cascade process, as a consequence of small perturbations of an apparently stable state. The conditions for the occurrence of cascade instabilities have been largely analysed in the literature, however for the same coordination models no sufficient attention was given to the relation between structural properties of (Nash) equilibria and possible outcomes of dynamical equilibrium selection. Using methods from the statistical physics of disordered systems, the present work investigates both analytically and numerically, the statistical properties of such Nash equilibria on networks, focusing mostly on random graphs. We provide an accurate description of these properties, which is then exploited to shed light on the mechanisms behind the onset of coordination/miscoordination on large networks. This is done studying the most common processes of dynamical equilibrium selection, such as best response, bounded-rational dynamics and learning processes. In particular, we show that well beyond the instability region, full coordination is still globally stochastically stable, however equilibrium selection processes with low stochasticity (e.g. best response) or strong memory effects (e.g. reinforcement learning) can be prevented from achieving full coordination by being trapped into a large (exponentially in number of agents) set of locally stable Nash equilibria at low/medium coordination (inefficient equilibria). These results should be useful to allow a better understanding of general coordination problems on complex networks.

categories: physics.soc-ph cond-mat.dis-nn cond-mat.stat-mech cs.GT


title: Detect the Interactions that Matter in Matter: Geometric Attention for Many-Body Systems

abstract: Attention mechanisms are developing into a viable alternative to convolutional layers as elementary building block of NNs. Their main advantage is that they are not restricted to capture local dependencies in the input, but can draw arbitrary connections. This unprecedented capability coincides with the long-standing problem of modeling global atomic interactions in molecular force fields and other many-body problems. In its original formulation, however, attention is not applicable to the continuous domains in which the atoms live. For this purpose we propose a variant to describe geometric relations for arbitrary atomic configurations in Euclidean space that also respects all relevant physical symmetries. We furthermore demonstrate, how the successive application of our learned attention matrices effectively translates the molecular geometry into a set of individual atomic contributions on-the-fly.


title: Certified DQBF Solving by Definition Extraction

abstract: We propose a new decision procedure for dependency quantified Boolean formulas (DQBF) that uses interpolation-based definition extraction to compute Skolem functions in a counter-example guided inductive synthesis (CEGIS) loop. In each iteration, a family of candidate Skolem functions is tested for correctness using a SAT solver, which either determines that a model has been found, or returns an assignment of the universal variables as a counterexample. Fixing a counterexample generally involves changing candidates of multiple existential variables with incomparable dependency sets. Our procedure introduces auxiliary variables -- which we call arbiter variables -- that each represent the value of an existential variable for a particular assignment of its dependency set. Possible repairs are expressed as clauses on these variables, and a SAT solver is invoked to find an assignment that deals with all previously seen counterexamples. Adding arbiter variables defines the values of Skolem functions for assignments where they were previously undefined, and may lead to the detection of Skolem functions by definition extraction in subsequent iterations. A key feature of the proposed procedure is that it is certifying by design: for true DQBF, models can be returned at minimal overhead. Towards certification of false formulas, we prove that clauses can be derived in an expansion-based proof system for DQBF. In an experimental evaluation on standard benchmark sets, an implementation was able to match (and in some cases, surpass) the performance of state-of-the-art DQBF solvers. Moreover, models could be generated and validated for all true instances that were solved.


title: Cross-correlation between $Planck$ CMB lensing potential and galaxy catalogues from HELP

abstract: We present the study of cross-correlation between Cosmic Microwave Background (CMB) gravitational lensing potential map released by the \textit{Planck} collaboration and photometric redshift galaxy catalogues from the \textit{Herschel} Extragalactic Legacy Project (HELP), divided into four sky patches: NGP, \textit{Herschel} Stripe-82, and two halves of SGP field, covering in total $\sim 660$ deg$^{2}$ of the sky. We estimate the galaxy linear bias parameter, $b_{0}$, from joint analysis of cross-power spectrum and galaxy auto-power spectrum using Maximum Likelihood Estimation technique to obtain values ranging from $0.70 \pm 0.01$ for SGP Part-2 to $1.02 \pm 0.02$ for SGP Part-1 field. We also estimate the amplitude of cross-correlation and find the values spanning from $0.67 \pm 0.18$ for SGP Part-2 to $0.80 \pm 0.23$ for SGP Part-1 field, respectively. For NGP and SGP Part-1 fields the amplitude is consistent with the expected value for the standard cosmological model within $\sim 1\,\sigma$, while for \textit{Herschel} Stripe-82 and SGP Part-2 we find the amplitude to be smaller than expected with $\sim 1.5\,\sigma$ and $\sim 2\,\sigma$ deviation, respectively. We perform several tests on various systematic errors to study the reason for the deviation, however, value of the amplitude turns out to be robust with respect to these errors. The only significant change in the amplitude is observed when we replace the minimum-variance CMB lensing map, used in the baseline analysis, by the lensing map derived from the CMB temperature map with deprojected thermal Sunyaev-Zeldovich signal.


title: Active Covering

abstract: We analyze the problem of active covering, where the learner is given an unlabeled dataset and can sequentially label query examples. The objective is to label query all of the positive examples in the fewest number of total label queries. We show under standard non-parametric assumptions that a classical support estimator can be repurposed as an offline algorithm attaining an excess query cost of $\widetilde{\Theta}(n^{D/(D+1)})$ compared to the optimal learner, where $n$ is the number of datapoints and $D$ is the dimension. We then provide a simple active learning method that attains an improved excess query cost of $\widetilde{O}(n^{(D-1)/D})$. Furthermore, the proposed algorithms only require access to the positive labeled examples, which in certain settings provides additional computational and privacy benefits. Finally, we show that the active learning method consistently outperforms offline methods as well as a variety of baselines on a wide range of benchmark image-based datasets.


title: Fair Exploration via Axiomatic Bargaining

abstract: Exploration is often necessary in online learning to maximize long-term reward, but it comes at the cost of short-term 'regret'. We study how this cost of exploration is shared across multiple groups. For example, in a clinical trial setting, patients who are assigned a sub-optimal treatment effectively incur the cost of exploration. When patients are associated with natural groups on the basis of, say, race or age, it is natural to ask whether the cost of exploration borne by any single group is 'fair'. So motivated, we introduce the 'grouped' bandit model. We leverage the theory of axiomatic bargaining, and the Nash bargaining solution in particular, to formalize what might constitute a fair division of the cost of exploration across groups. On the one hand, we show that any regret-optimal policy strikingly results in the least fair outcome: such policies will perversely leverage the most 'disadvantaged' groups when they can. More constructively, we derive policies that are optimally fair and simultaneously enjoy a small 'price of fairness'. We illustrate the relative merits of our algorithmic framework with a case study on contextual bandits for warfarin dosing where we are concerned with the cost of exploration across multiple races and age groups.


title: Recovering Multiple Fractional Orders in Time-Fractional Diffusion in an Unknown Medium

abstract: In this work, we investigate an inverse problem of recovering multiple orders in a time-fractional diffusion model from the data observed at one single point on the boundary. We prove the unique recovery of the orders together with their weights, which does not require a full knowledge of the domain or medium properties, e.g., diffusion and potential coefficients, initial condition and source in the model. The proof is based on Laplace transform and asymptotic expansion. Further, inspired by the analysis, we propose a numerical procedure for recovering these parameters based on a nonlinear least-squares fitting with either fractional polynomials or rational approximations as the model function, and provide numerical experiments to illustrate the approach for small time $t$.


title: Extension of Alon's and Friedman's conjectures to Schottky surfaces

abstract: Let $X=\Lambda\backslash\mathbb{H}$ be a Schottky surface, that is, a conformally compact hyperbolic surface of infinite area. Let $\delta$ denote the Hausdorff dimension of the limit set of $\Lambda$. We prove that for any compact subset $\mathcal{K} \subset\{\,s\,:\,\Re(s)>\frac{\delta}{2}\,\}$, if one picks a random degree $n$ cover $X_{n}$ of $X$ uniformly at random, then with probability tending to one as $n\to\infty$, there are no resonances of $X_{n}$ in $\mathcal{K}$ other than those already belonging to $X$ (and with the same multiplicity). This result is conjectured to be the optimal one for bounded frequency resonances and is analogous to both Alon's and Friedman's conjectures for random graphs, which are now theorems due to Friedman and Bordenave-Collins, respectively.


title: Musical Prosody-Driven Emotion Classification: Interpreting Vocalists Portrayal of Emotions Through Machine Learning

abstract: The task of classifying emotions within a musical track has received widespread attention within the Music Information Retrieval (MIR) community. Music emotion recognition has traditionally relied on the use of acoustic features, verbal features, and metadata-based filtering. The role of musical prosody remains under-explored despite several studies demonstrating a strong connection between prosody and emotion. In this study, we restrict the input of traditional machine learning algorithms to the features of musical prosody. Furthermore, our proposed approach builds upon the prior by classifying emotions under an expanded emotional taxonomy, using the Geneva Wheel of Emotion. We utilize a methodology for individual data collection from vocalists, and personal ground truth labeling by the artist themselves. We found that traditional machine learning algorithms when limited to the features of musical prosody (1) achieve high accuracies for a single singer, (2) maintain high accuracy when the dataset is expanded to multiple singers, and (3) achieve high accuracies when trained on a reduced subset of the total features.


title: Towards charged hadron polarizabilities from four-point functions in lattice QCD

abstract: We show how to compute electromagnetic polarizabilities of charged hadrons using four-point functions in lattice QCD. The low-energy behavior of Compton scattering amplitude is matched to matrix elements of current-current correlation functions on the lattice. Working in momentum space, formulas for electric polarizability ($\alpha_E$) and magnetic polarizability ($\beta_M$) are derived for both charged pion and proton. Lattice four-point correlation functions are constructed from quark and gluon fields to be used in Monte-Carlo simulations. The content of the functions is assessed in detail and specific prescriptions are given to isolate the polarizabilities. The connected quark-line diagrams can be done today as a small lattice project. The disconnected diagrams are more challenging but are within reach of dedicated resources for medium to large lattice projects. We also draw attention to the potential of four-point functions as a multi-purpose tool for hadron structure.


title: Bayesian Risk Markov Decision Processes

abstract: We consider finite-horizon Markov Decision Processes where parameters, such as transition probabilities, are unknown and estimated from data. The popular distributionally robust approach to addressing the parameter uncertainty can sometimes be overly conservative. In this paper, we propose a new formulation, Bayesian risk Markov Decision Process (BR-MDP), to address parameter uncertainty in MDPs, where a risk functional is applied in nested form to the expected total cost with respect to the Bayesian posterior distribution of the unknown parameters. The proposed formulation provides more flexible risk attitutes towards parameter uncertainty and takes into account the availability of data in future times stages. To solve the proposed formulation with the conditional value-at-risk (CVaR) risk functional, we propose an efficient approximation algorithm by deriving an analytical approximation of the value function and utilizing the convexity of CVaR. We demonstrate the empirical performance of the BR-MDP formulation and proposed algorithms on a gambler's betting problem and an inventory control problem.


title: Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing

abstract: Analysing whether neural language models encode linguistic information has become popular in NLP. One method of doing so, which is frequently cited to support the claim that models like BERT encode syntax, is called probing; probes are small supervised models trained to extract linguistic information from another model's output. If a probe is able to predict a particular structure, it is argued that the model whose output it is trained on must have implicitly learnt to encode it. However, drawing a generalisation about a model's linguistic knowledge about a specific phenomena based on what a probe is able to learn may be problematic: in this work, we show that semantic cues in training data means that syntactic probes do not properly isolate syntax. We generate a new corpus of semantically nonsensical but syntactically well-formed Jabberwocky sentences, which we use to evaluate two probes trained on normal data. We train the probes on several popular language models (BERT, GPT, and RoBERTa), and find that in all settings they perform worse when evaluated on these data, for one probe by an average of 15.4 UUAS points absolute. Although in most cases they still outperform the baselines, their lead is reduced substantially, e.g. by 53% in the case of BERT for one probe. This begs the question: what empirical scores constitute knowing syntax?


title: Ensemble reduced density matrix functional theory for excited states and hierarchical generalization of Pauli's exclusion principle

abstract: We propose and work out a reduced density matrix functional theory (RDMFT) for calculating energies of eigenstates of interacting many-electron systems beyond the ground state. Various obstacles which historically have doomed such an approach to be unfeasible are overcome. First, we resort to a generalization of the Ritz variational principle to ensemble states with fixed weights. This in combination with the constrained search formalism allows us to establish a universal functional of the one-particle reduced density matrix. Second, we employ tools from convex analysis to circumvent the too involved N-representability constraints. Remarkably, this identifies Valone's pioneering work on RDMFT as a special case of convex relaxation and reveals that crucial information about the excitation structure is contained in the functional's domain. Third, to determine the crucial latter object, a methodology is developed which eventually leads to a generalized exclusion principle. The corresponding linear constraints are calculated for systems of arbitrary size.

categories: quant-ph cond-mat.str-el math-ph math.MP


title: Great Service! Fine-grained Parsing of Implicit Arguments

abstract: Broad-coverage meaning representations in NLP mostly focus on explicitly expressed content. More importantly, the scarcity of datasets annotating diverse implicit roles limits empirical studies into their linguistic nuances. For example, in the web review "Great service!", the provider and consumer are implicit arguments of different types. We examine an annotated corpus of fine-grained implicit arguments (Cui and Hershcovich, 2020) by carefully re-annotating it, resolving several inconsistencies. Subsequently, we present the first transition-based neural parser that can handle implicit arguments dynamically, and experiment with two different transition systems on the improved dataset. We find that certain types of implicit arguments are more difficult to parse than others and that the simpler system is more accurate in recovering implicit arguments, despite having a lower overall parsing score, attesting current reasoning limitations of NLP models. This work will facilitate a better understanding of implicit and underspecified language, by incorporating it holistically into meaning representations.


title: Recurrent Neural Networks with Mixed Hierarchical Structures for Natural Language Processing

abstract: Hierarchical structures exist in both linguistics and Natural Language Processing (NLP) tasks. How to design RNNs to learn hierarchical representations of natural languages remains a long-standing challenge. In this paper, we define two different types of boundaries referred to as static and dynamic boundaries, respectively, and then use them to construct a multi-layer hierarchical structure for document classification tasks. In particular, we focus on a three-layer hierarchical structure with static word- and sentence- layers and a dynamic phrase-layer. LSTM cells and two boundary detectors are used to implement the proposed structure, and the resulting network is called the {\em Recurrent Neural Network with Mixed Hierarchical Structures} (MHS-RNN). We further add three layers of attention mechanisms to the MHS-RNN model. Incorporating attention mechanisms allows our model to use more important content to construct document representation and enhance its performance on document classification tasks. Experiments on five different datasets show that the proposed architecture outperforms previous methods on all the five tasks.


title: Electronic band crossing in sliding bilayer graphene: Tight-binding calculations and symmetry group representation analysis

abstract: Dirac points are found to emerge due to the crossing of bands in the electronic structure of bilayer graphene for configurations in which the alignment between two hexagonal lattices preserves the parallelism of the armchair/zigzag lines between two layers. On the base of electronic calculations using a tight-binding model for the $\pi$ bands it is shown that the crossing of the energy-band dispersion curves occurs in the vicinity of the corner points of the hexagonal Brillouin zone. Group representation theory analysis confirms the emergence of such Dirac points. It is demonstrated that the band crossings at generic $\mathbf{k}$ points are guaranteed by the compatibility relations between the symmetries of eigenstates at the high-symmetry $\mathbf{k}$ points in the Brillouin zone. The presence of Dirac points governs the geometrical properties of the energy surfaces, and thus the topological structure of the Fermi energy surface and the energy spectrum.


title: Charges via the Affine Grassmannian

abstract: We give a new construction of Lascoux-Sch\"utzenberger's charge statistic in type A which is motivated by the geometric Satake equivalence We obtain a new formula for the charge statistic in terms of modified crystal operators and an independent proof of this formula not relying on tableaux combinatorics.


title: The Poisson spectrum of the symmetric algebra of the Virasoro algebra

abstract: Let $W = \mathbb{C}[t,t^{-1}]\partial_t$ be the Witt algebra of algebraic vector fields on $\mathbb{C}^\times$ and let $Vir$ be the Virasoro algebra, the unique nontrivial central extension of $W$. In this paper, we study the Poisson ideal structure of the symmetric algebras of $Vir$ and $W$, as well as several related Lie algebras. We classify prime Poisson ideals and Poisson primitive ideals of $S(Vir)$ and $S(W)$. In particular, we show that the only functions in $W^*$ which vanish on a nontrivial Poisson ideal (that is, the only maximal ideals of $S(W)$ with a nontrivial Poisson core) are given by linear combinations of derivatives at a finite set of points; we call such functions local. Given a local function $\chi\in W^*$, we construct the associated Poisson primitive ideal through computing the algebraic symplectic leaf of $\chi$, which gives a notion of coadjoint orbit in our setting. As an application, we prove a structure theorem for subalgebras of $Vir$ of finite codimension and show in particular that any such subalgebra of $Vir$ contains the central element $z$, substantially generalising a result of Ondrus and Wiesner on subalgebras of codimension 1. As a consequence, we deduce that $S(Vir)/(z-\lambda)$ is Poisson simple if and only if $\lambda \neq 0$.


title: BR-NPA: A Non-Parametric High-Resolution Attention Model to improve the Interpretability of Attention

abstract: The prevalence of employing attention mechanisms has brought along concerns on the interpretability of attention distributions. Although it provides insights about how a model is operating, utilizing attention as the explanation of model predictions is still highly dubious. The community is still seeking more interpretable strategies for better identifying local active regions that contribute the most to the final decision. To improve the interpretability of existing attention models, we propose a novel Bilinear Representative Non-Parametric Attention (BR-NPA) strategy that captures the task-relevant human-interpretable information. The target model is first distilled to have higher-resolution intermediate feature maps. From which, representative features are then grouped based on local pairwise feature similarity, to produce finer-grained, more precise attention maps highlighting task-relevant parts of the input. The obtained attention maps are ranked according to the activity level of the compound feature, which provides information regarding the important level of the highlighted regions. The proposed model can be easily adapted in a wide variety of modern deep models, where classification is involved. Extensive quantitative and qualitative experiments showcase more comprehensive and accurate visual explanations compared to state-of-the-art attention models and visualizations methods across multiple tasks including fine-grained image classification, few-shot classification, and person re-identification, without compromising the classification accuracy. The proposed visualization model sheds imperative light on how neural networks `pay their attention' differently in different tasks.


title: AI Driven Road Maintenance Inspection

abstract: Road infrastructure maintenance inspection is typically a labour-intensive and critical task to ensure the safety of all the road users. In this work, we propose a detailed methodology to use state-of-the-art techniques in artificial intelligence and computer vision to automate a sizeable portion of the maintenance inspection subtasks and reduce the labour costs. The proposed methodology uses state-of-the-art computer vision techniques such as object detection and semantic segmentation to automate inspections on primary road structures such as the road surface, markings, barriers (guardrails) and traffic signs. The models are mostly trained on commercially viable datasets and augmented with proprietary data. We demonstrate that our AI models can not only automate and scale maintenance inspections on primary road structures but also result in higher recall compared to traditional manual inspections.


title: Training Energy-Efficient Deep Spiking Neural Networks with Time-to-First-Spike Coding

abstract: The tremendous energy consumption of deep neural networks (DNNs) has become a serious problem in deep learning. Spiking neural networks (SNNs), which mimic the operations in the human brain, have been studied as prominent energy-efficient neural networks. Due to their event-driven and spatiotemporally sparse operations, SNNs show possibilities for energy-efficient processing. To unlock their potential, deep SNNs have adopted temporal coding such as time-to-first-spike (TTFS)coding, which represents the information between neurons by the first spike time. With TTFS coding, each neuron generates one spike at most, which leads to a significant improvement in energy efficiency. Several studies have successfully introduced TTFS coding in deep SNNs, but they showed restricted efficiency improvement owing to the lack of consideration for efficiency during training. To address the aforementioned issue, this paper presents training methods for energy-efficient deep SNNs with TTFS coding. We introduce a surrogate DNN model to train the deep SNN in a feasible time and analyze the effect of the temporal kernel on training performance and efficiency. Based on the investigation, we propose stochastically relaxed activation and initial value-based regularization for the temporal kernel parameters. In addition, to reduce the number of spikes even further, we present temporal kernel-aware batch normalization. With the proposed methods, we could achieve comparable training results with significantly reduced spikes, which could lead to energy-efficient deep SNNs.


title: Neural semi-Markov CRF for Monolingual Word Alignment

abstract: Monolingual word alignment is important for studying fine-grained editing operations (i.e., deletion, addition, and substitution) in text-to-text generation tasks, such as paraphrase generation, text simplification, neutralizing biased language, etc. In this paper, we present a novel neural semi-Markov CRF alignment model, which unifies word and phrase alignments through variable-length spans. We also create a new benchmark with human annotations that cover four different text genres to evaluate monolingual word alignment models in more realistic settings. Experimental results show that our proposed model outperforms all previous approaches for monolingual word alignment as well as a competitive QA-based baseline, which was previously only applied to bilingual data. Our model demonstrates good generalizability to three out-of-domain datasets and shows great utility in two downstream applications: automatic text simplification and sentence pair classification tasks.


title: Joint Scheduling and Throughput Maximization in Self-backhauled Millimeter Wave Cellular Networks

abstract: Integrated access and backhaul (IAB) networks have the potential to provide high data rate in both access and backhaul networks by sharing the same spectrum. Due to the dense deployment of small base stations (SBSs), IAB networks connect SBSs to the core network in a wireless manner without the deployment of high-cost optical fiber. As large spectrum is available in mmWave bands and high data rate is achieved by using directional beamforming, the access and backhaul links can be integrated in the same frequency band while satisfying quality-of-service constraints. In this work, we optimize the scheduling of access and backhaul links such that the minimum throughput of the access links is maximized based on the revised simplex method. By considering a probability based line-ofsight (LOS) and non-line-of-sight (NLOS) path loss model and the antenna array gains, we compare the achievable minimum access throughput of the IAB network with the network with only macro base stations, and study the effect of the network topology and antenna parameters on the achievable minimum throughput. Simulation results show that, for a broad range of parameter settings, the implementation of IABs improves the access minimum achievable throughput.


title: The Inclusion Problem for Forest Languages under Substitutions

abstract: We consider algorithms and lower bounds for various problems over forest languages; as input models we allow forest algebras, deterministic forest automata and nondeterministic forest automata. For the equivalence problem, we give an almost-linear-time algorithm for both forest algebras and deterministic forest automata; this is complemented by a polynomial time hardness result. The emptiness problem is complete for polynomial time over each of the three models. Additionally, we consider the emptiness of intersection problem for forest algebras and deterministic forest automata; this problem turns out to be complete for exponential time. It is well-known that the corresponding problems for word languages are complete for nondeterministic logarithmic space and for polynomial space, respectively. Equipped with this toolbox of algorithms and lower bounds, we consider various inclusion problems for regular forest languages under substitutions. The substitutions in this paper replace leaf variables by forest languages. Depending on the direction of the inclusion, the problem for a given substitution is either complete for polynomial time or for exponential time; in particular, the equivalence problem under substitutions is complete for exponential time and, hence, more difficult than the equivalence problem for forest languages without substitutions. If we ask whether there exists a substitution such that a given inclusion holds, then this problem is either complete for NP or exponential time, depending on whether we consider inclusion or equivalence; moreover, the problem is undecidable if the substitution is applied on both sides.


title: On the Origins of the Oceanic Ultraviolet Catastrophe

abstract: We provide a first-principles analysis of the energy fluxes in the oceanic internal wavefield. The resulting formula is remarkably similar to the renowned phenomenological formula for the turbulent dissipation rate in the ocean which is known as the Finescale Parameterization. The prediction is based on the wave turbulence theory of internal gravity waves and on a new methodology devised for the computation of the associated energy fluxes. In the standard spectral representation of the wave energy density, in the two-dimensional vertical wavenumber - frequency domain, the energy fluxes associated with the steady state are found to be directed downscale in both coordinates, closely matching the Finescale-Parameterization formula in functional form and in magnitude. These energy transfers are composed of a `local' and a `scale-separated' contributions; while the former is quantified numerically, the latter is dominated by the Induced Diffusion process and is amenable to analytical treatment. Contrary to previous results indicating an inverse energy cascade from high frequency to low, at odds with observations, our analysis of all non-zero coefficients of the diffusion tensor predicts a direct energy cascade. Moreover, by the same analysis fundamental spectra that had been deemed `no-flux' solutions are reinstated to the status of `constant-downscale-flux' solutions. This is consequential for an understanding of energy fluxes, sources and sinks that fits in the observational paradigm of the Finescale Parameterization, solving at once two long-standing paradoxes that had earned the name of `Oceanic Ultraviolet Catastrophe'.


title: Rewriting Theory for the Life Sciences: A Unifying Theory of CTMC Semantics (Long version)

abstract: The Kappa biochemistry and the M{\O}D organic chemistry frameworks are amongst the most intensely developed applications of rewriting-based methods in the life sciences to date. A typical feature of these types of rewriting theories is the necessity to implement certain structural constraints on the objects to be rewritten (a protein is empirically found to have a certain signature of sites, a carbon atom can form at most four bonds, ...). In this paper, we contribute a number of original developments that permit to implement a universal theory of continuous-time Markov chains (CTMCs) for stochastic rewriting systems. Our core mathematical concepts are a novel rule algebra construction for the relevant setting of rewriting rules with conditions, both in Double- and in Sesqui-Pushout semantics, augmented by a suitable stochastic mechanics formalism extension that permits to derive dynamical evolution equations for pattern-counting statistics. A second main contribution of our paper is a novel framework of restricted rewriting theories, which comprises a rule-algebra calculus under the restriction to so-called constraint-preserving completions of application conditions (for rules considered to act only upon objects of the underlying category satisfying a globally fixed set of structural constraints). This novel framework in turn renders a faithful encoding of bio- and organo-chemical rewriting in the sense of Kappa and M{\O}D possible, which allows us to derive a rewriting-based formulation of reaction systems including a full-fledged CTMC semantics as instances of our universal CTMC framework. While offering an interesting new perspective and conceptual simplification of this semantics in the setting of Kappa, both the formal encoding and the CTMC semantics of organo-chemical reaction systems as motivated by the M{\O}D framework are the first such results of their kind.


title: Two-photon resonance fluorescence of two interacting non-identical quantum emitters

abstract: We study a system of two interacting, non-indentical quantum emitters driven by a coherent field. We focus on the particular condition of two-photon resonance and obtain analytical expressions for the stationary density matrix of the system and observables of the fluorescent emission. Importantly, our expressions are valid for the general situation of non-identical emitters with different transition energies. Our results allow us to determine the regime of parameters in which coherent two-photon excitation, enabled by the coherent coupling between emitters, is dominant over competing, first-order processes. Using the formalism of quantum parameter estimation, we show that the features imprinted by the two-photon dynamics into the spectrum of resonance fluorescence are particularly sensitive to changes in the distance between emitters, making two-photon excitation the optimal driving regime for the estimation of inter-emitter distance. This can be exploited for applications such as superresolution imaging of point-like sources.


title: Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Bandits

abstract: In this paper we investigate the problem of stochastic multi-armed bandits (MAB) in the (local) differential privacy (DP/LDP) model. Unlike previous results that assume bounded/sub-Gaussian reward distributions, we focus on the setting where each arm's reward distribution only has $(1+v)$-th moment with some $v\in (0, 1]$. In the first part, we study the problem in the central $\epsilon$-DP model. We first provide a near-optimal result by developing a private and robust Upper Confidence Bound (UCB) algorithm. Then, we improve the result via a private and robust version of the Successive Elimination (SE) algorithm. Finally, we establish the lower bound to show that the instance-dependent regret of our improved algorithm is optimal. In the second part, we study the problem in the $\epsilon$-LDP model. We propose an algorithm that can be seen as locally private and robust version of SE algorithm, which provably achieves (near) optimal rates for both instance-dependent and instance-independent regret. Our results reveal differences between the problem of private MAB with bounded/sub-Gaussian rewards and heavy-tailed rewards. To achieve these (near) optimal rates, we develop several new hard instances and private robust estimators as byproducts, which might be used to other related problems. Finally, experiments also support our theoretical findings and show the effectiveness of our algorithms.


title: Inherent Non-Linear Damping in Resonators with Inertia Amplification

abstract: Inertia amplification is a mechanism coupling degrees of freedom within a vibrating structure. Its goal is to achieve an apparent high dynamic mass and, accordingly, a low resonance frequency. Such structures have been described for use in locally resonant metamaterials and phononic crystals to lower the starting frequency of a band gap without adding mass to the system. This study shows that any non-linear kinematic coupling between translational or rotational vibrations leads to the appearance of amplitude-dependent damping. The analytical derivation of the equation of motion of a resonator with inertia amplification creates insight in the damping process, and shows that the vibration damping increases with its amplitude. The theoretical study is validated by experimental evidence from two types of inertia-amplification resonators. Finally, the importance of amplitude-dependent damping is illustrated when the structure is used as a tuned mass damper for a cantilever beam.


title: Magnetic Structure of CoO

abstract: The paper reports theoretical evidence that the multi-spin-axis magnetic structure proposed in 1964 by van Laar actually does exist in CoO. This tetragonal spin arrangement produces both the strong tetragonal and the weaker monoclinic distortion experimentally observed in this material. The monoclinic distortion is proposed to be a "monoclinic-like" distortion of the array of the oxygen atoms, comparable with the rhombohedral-like distortion of the oxygen atoms recently proposed to be present in NiO and MnO. The monoclinic-like distortion has no influence on the tetragonal magnetic structure which is generated by a special nonadiabatic atomic-like motion of the electrons near the Fermi level. It is argued that it is this special atomic-like motion which qualifies CoO to be a Mott insulator.


title: Alexa, Google, Siri: What are Your Pronouns? Gender and Anthropomorphism in the Design and Perception of Conversational Assistants

abstract: Technology companies have produced varied responses to concerns about the effects of the design of their conversational AI systems. Some have claimed that their voice assistants are in fact not gendered or human-like -- despite design features suggesting the contrary. We compare these claims to user perceptions by analysing the pronouns they use when referring to AI assistants. We also examine systems' responses and the extent to which they generate output which is gendered and anthropomorphic. We find that, while some companies appear to be addressing the ethical concerns raised, in some cases, their claims do not seem to hold true. In particular, our results show that system outputs are ambiguous as to the humanness of the systems, and that users tend to personify and gender them as a result.


title: The Willmore flow with prescribed isoperimetric ratio

abstract: We introduce a non-local $L^2$-gradient flow for the Willmore energy of immersed surfaces which preserves the isoperimetric ratio. For spherical initial data with energy below an explicit threshold, we show long-time existence and convergence to a Helfrich immersion. This is in sharp contrast to the locally constrained flow, where finite time singularities occur.


title: How cost impacts equitable participation in astronomy outreach events

abstract: The International Astronomical Youth Camp (IAYC) is an astronomy education outreach event with more than 50 years of history and over 1,700 unique participants from 81 nationalities. The International Workshop for Astronomy e.V. (IWA) is the non-profit organization behind the IAYC, established in 1979 and based in Germany. The IAYC's unprecedented longevity in a rapidly globalizing world has meant that financial inequities decreases the reach of the camp to people from the Global South compared to Global North countries. Though nationalities represented per camp has increased steadily since its inception, the share of participants from eastern Europe and Africa has dropped, while those from western Europe and North America have increased. This note examines how camp cost, location, and leadership affects nationality diversity amongst participants, and how astronomy outreach events must reckon with funding for less privileged participants with limited access to resources.


title: BERT-Based Sentiment Analysis: A Software Engineering Perspective

abstract: Sentiment analysis can provide a suitable lead for the tools used in software engineering along with the API recommendation systems and relevant libraries to be used. In this context, the existing tools like SentiCR, SentiStrength-SE, etc. exhibited low f1-scores that completely defeats the purpose of deployment of such strategies, thereby there is enough scope for performance improvement. Recent advancements show that transformer based pre-trained models (e.g., BERT, RoBERTa, ALBERT, etc.) have displayed better results in the text classification task. Following this context, the present research explores different BERT-based models to analyze the sentences in GitHub comments, Jira comments, and Stack Overflow posts. The paper presents three different strategies to analyse BERT based model for sentiment analysis, where in the first strategy the BERT based pre-trained models are fine-tuned; in the second strategy an ensemble model is developed from BERT variants, and in the third strategy a compressed model (Distil BERT) is used. The experimental results show that the BERT based ensemble approach and the compressed BERT model attain improvements by 6-12% over prevailing tools for the F1 measure on all three datasets.


title: Partially-Averaged Navier-Stokes Simulations of Turbulence Within a High-Order Flux Reconstruction Framework

abstract: High-order methods and hybrid turbulence models have independently shown promise as means of decreasing the computational cost of scale-resolving simulations. The objective of this work is to develop the combination of these methods and analyze the effects of high-order discretizations on hybrid turbulence models, particularly with respect the optimal model parameters and the relative accuracy benefits compared to approaches such as under-resolved direct numerical simulation (URDNS). We employ the Partially-Averaged Navier-Stokes (PANS) approach using the flux reconstruction scheme on the flow around a periodic hill and the wake flow of a circular cylinder at a Reynolds number of 3900, the latter of which we provide direct numerical simulation results and novel statistical analysis. By increasing the order of the discretization while fixing the total degrees of freedom, it was observed that larger improvements in the prediction of the statistics and flow physics were generally seen with PANS than URDNS. Furthermore, less sensitivity to the resolution-control parameter was observed with a high-order discretization, indicating that high-order discretizations may be an effective approach for increasing the accuracy and reliability of hybrid turbulence models for scale-resolving simulations without a significant increase in computational effort.


title: Feedback design of spatially-distributed filters with tunable resolution

abstract: We derive gain-tuning rules for the positive and negative spatial-feedback loops of a spatially-distributed filter to change the resolution of its spatial band-pass characteristic accordingly to a wavelet zoom, while preserving temporal stability. The filter design is inspired by the canonical spatial feedback structure of the primary visual cortex and is motivated by understanding attentional control of visual resolution. Besides biology, our control-theoretical design strategy is relevant for the development of neuromorphic multiresolution distributed sensors through the feedback interconnection of elementary spatial transfer functions and gain tuning.


title: Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning

abstract: We challenge a common assumption underlying most supervised deep learning: that a model makes a prediction depending only on its parameters and the features of a single input. To this end, we introduce a general-purpose deep learning architecture that takes as input the entire dataset instead of processing one datapoint at a time. Our approach uses self-attention to reason about relationships between datapoints explicitly, which can be seen as realizing non-parametric models using parametric attention mechanisms. However, unlike conventional non-parametric models, we let the model learn end-to-end from the data how to make use of other datapoints for prediction. Empirically, our models solve cross-datapoint lookup and complex reasoning tasks unsolvable by traditional deep learning models. We show highly competitive results on tabular data, early results on CIFAR-10, and give insight into how the model makes use of the interactions between points.


title: A Procedural World Generation Framework for Systematic Evaluation of Continual Learning

abstract: Several families of continual learning techniques have been proposed to alleviate catastrophic interference in deep neural network training on non-stationary data. However, a comprehensive comparison and analysis of limitations remains largely open due to the inaccessibility to suitable datasets. Empirical examination not only varies immensely between individual works, it further currently relies on contrived composition of benchmarks through subdivision and concatenation of various prevalent static vision datasets. In this work, our goal is to bridge this gap by introducing a computer graphics simulation framework that repeatedly renders only upcoming urban scene fragments in an endless real-time procedural world generation process. At its core lies a modular parametric generative model with adaptable generative factors. The latter can be used to flexibly compose data streams, which significantly facilitates a detailed analysis and allows for effortless investigation of various continual learning schemes.


title: Spectral Non-integer Derivative Representations and the Exact Spectral Derivative Discretization Finite Difference Method for the Fokker-Planck Equation

abstract: Universal difference quotient representations are introduced for the exact self-sameness principles (SSP) as rules for rates of change introduced in [Clemence-Mkhope, D.P (2021, Preprint). The Exact Spectral Derivative Discretization Finite Difference (ESDDFD) Method for Wave Models. arXiv]. Properties are presented for the fundamental rule, a generalized derivative representation which is shown to yield some known non-integer derivatives as limit cases of such natural derivative measures; this is shown for some local derivatives of conformable, fractional, or fractal type and non-local derivatives of Caputo and Riemann-Liouville type. The SSP-inspired exact spectral derivative discretization finite difference method is presented for the Fokker-Planck non-fractional and time-fractional equations; the resulting discrete models recover exactly some known behaviors predicted for the processes modeled, such as the Gibbs-Boltzmann distribution and the Einstein-Stokes-Smoluchowski relation; new ones are predicted.


title: Factorisation in Restriction theory and near extremisers

abstract: We give an alternative argument to the application of the so-called Maurey- Nikishin-Pisier factorisation in Fourier restriction theory. Based on an induction-on-scales argument, our comparably simple method applies to any compact quadratic surface, in particular compact parts of the paraboloid and the hyperbolic paraboloid. This is achieved by constructing near extremisers with big "mass", which itself might be of interest.


title: Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis

abstract: The representation of functions by artificial neural networks depends on a large number of parameters in a non-linear fashion. Suitable parameters of these are found by minimizing a 'loss functional', typically by stochastic gradient descent (SGD) or an advanced SGD-based algorithm. In a continuous time model for SGD with noise that follows the 'machine learning scaling', we show that in a certain noise regime, the optimization algorithm prefers 'flat' minima of the objective function in a sense which is different from the flat minimum selection of continuous time SGD with homogeneous noise.


title: On Ensembling vs Merging: Least Squares and Random Forests under Covariate Shift

abstract: It has been postulated and observed in practice that for prediction problems in which covariate data can be naturally partitioned into clusters, ensembling algorithms based on suitably aggregating models trained on individual clusters often perform substantially better than methods that ignore the clustering structure in the data. In this paper, we provide theoretical support to these empirical observations by asymptotically analyzing linear least squares and random forest regressions under a linear model. Our main results demonstrate that the benefit of ensembling compared to training a single model on the entire data, often termed 'merging', might depend on the underlying bias and variance interplay of the individual predictors to be aggregated. In particular, under both fixed and high dimensional linear models, we show that merging is asymptotically superior to optimal ensembling techniques for linear least squares regression due to the unbiased nature of least squares prediction. In contrast, for random forest regression under fixed dimensional linear models, our bounds imply a strict benefit of ensembling over merging. Finally, we also present numerical experiments to verify the validity of our asymptotic results across different situations.


title: Spatially relaxed inference on high-dimensional linear models

abstract: We consider the inference problem for high-dimensional linear models, when covariates have an underlying spatial organization reflected in their correlation. A typical example of such a setting is high-resolution imaging, in which neighboring pixels are usually very similar. Accurate point and confidence intervals estimation is not possible in this context with many more covariates than samples, furthermore with high correlation between covariates. This calls for a reformulation of the statistical inference problem, that takes into account the underlying spatial structure: if covariates are locally correlated, it is acceptable to detect them up to a given spatial uncertainty. We thus propose to rely on the $\delta$-FWER, that is the probability of making a false discovery at a distance greater than $\delta$ from any true positive. With this target measure in mind, we study the properties of ensembled clustered inference algorithms which combine three techniques: spatially constrained clustering, statistical inference, and ensembling to aggregate several clustered inference solutions. We show that ensembled clustered inference algorithms control the $\delta$-FWER under standard assumptions for $\delta$ equal to the largest cluster diameter. We complement the theoretical analysis with empirical results, demonstrating accurate $\delta$-FWER control and decent power achieved by such inference algorithms.


title: Cross-correlating Astrophysical and Cosmological Gravitational Wave Backgrounds with the Cosmic Microwave Background

abstract: General Relativity provides us with an extremely powerful tool to extract at the same time astrophysical and cosmological information from the Stochastic Gravitational Wave Backgrounds (SGWBs): the cross-correlation with other cosmological tracers, since their anisotropies share a common origin and the same perturbed geodesics. In this letter we explore the cross-correlation of the cosmological and astrophysical SGWBs with Cosmic Microwave Background (CMB) anisotropies, showing that future GW detectors, such as LISA or BBO, have the ability to measure such cross-correlation signals. We also present, as a new tool in this context, constrained realization maps of the SGWBs extracted from the high-resolution CMB {\it Planck} maps. This technique allows, in the low-noise regime, to faithfully reconstruct the expected SGWB map by starting from CMB measurements.


title: Multi-partonic medium induced cascades in expanding media

abstract: Going beyond the simplified gluonic cascades, we introduce both gluon and quark degrees of freedom for partonic cascades inside the medium. We then solve the set of coupled evolution equations numerically with splitting kernels calculated for static, exponential, and Bjorken expanding media to arrive at medium-modified parton spectra for quark and gluon initiated jets. Using these, we calculate the inclusive jet $R_{AA}$ where the phenomenologically driven combinations of quark and gluon jet fractions are included. Then, the rapidity dependence of the jet $R_{AA}$ is examined. We also study the path-length dependence of jet quenching for different types of expanding media by calculating the jet $v_2$. Additionally, we study the sensitivity of observables on effects from nuclear modification of parton distribution functions, vacuum-like emissions in the plasma, and the time of the onset of the quenching. All calculations are compared with recently measured data.


title: Connecting geometry and performance of two-qubit parameterized quantum circuits

abstract: Parameterized quantum circuits (PQCs) are a central component of many variational quantum algorithms, yet there is a lack of understanding of how their parameterization impacts algorithm performance. We initiate this discussion by using principal bundles to geometrically characterize two-qubit PQCs. On the base manifold, we use the Mannoury-Fubini-Study metric to find a simple equation relating the Ricci scalar (geometry) and concurrence (entanglement). By calculating the Ricci scalar during a variational quantum eigensolver (VQE) optimization process, this offers us a new perspective to how and why Quantum Natural Gradient outperforms the standard gradient descent. We argue that the key to the Quantum Natural Gradient's superior performance is its ability to find regions of high negative curvature early in the optimization process. These regions of high negative curvature appear to be important in accelerating the optimization process.


title: Self-Supervised Learning of Domain Invariant Features for Depth Estimation

abstract: We tackle the problem of unsupervised synthetic-to-real domain adaptation for single image depth estimation. An essential building block of single image depth estimation is an encoder-decoder task network that takes RGB images as input and produces depth maps as output. In this paper, we propose a novel training strategy to force the task network to learn domain invariant representations in a selfsupervised manner. Specifically, we extend self-supervised learning from traditional representation learning, which works on images from a single domain, to domain invariant representation learning, which works on images from two different domains by utilizing an image-to-image translation network. Firstly, we use an image-to-image translation network to transfer domain-specific styles between synthetic and real domains. This style transfer operation allows us to obtain similar images from the different domains. Secondly, we jointly train our task network and Siamese network with the same images from the different domains to obtain domain invariance for the task network. Finally, we fine-tune the task network using labeled synthetic and unlabeled realworld data. Our training strategy yields improved generalization capability in the real-world domain. We carry out an extensive evaluation on two popular datasets for depth estimation, KITTI and Make3D. The results demonstrate that our proposed method outperforms the state-of-the-art on all metrics, e.g. by 14.7% on Sq Rel on KITTI. The source code and model weights will be made available.


title: Tidal deformation of dynamical horizons in binary black hole mergers

abstract: An important physical phenomenon that manifests itself during the inspiral of two orbiting compact objects is the tidal deformation of each under the gravitational influence of its companion. In the case of binary neutron star mergers, this tidal deformation and the associated Love numbers have been used to probe properties of dense matter and the nuclear equation of state. Non-spinning black holes on the other hand have a vanishing (field) tidal Love number in General Relativity. This pertains to the deformation of the asymptotic gravitational field. In certain cases, especially in the late stages of the inspiral phase when the black holes get close to each other, the source multipole moments might be more relevant in probing their properties and the No-Hair conjecture; contrastingly, these Love numbers do not vanish. In this paper, we track the source multipole moments in simulations of several binary black hole mergers and calculate these Love numbers. We present evidence that, at least for modest mass ratios, the behavior of the source multipole moments is universal.


title: Understanding and Countering Stereotypes: A Computational Approach to the Stereotype Content Model

abstract: Stereotypical language expresses widely-held beliefs about different social categories. Many stereotypes are overtly negative, while others may appear positive on the surface, but still lead to negative consequences. In this work, we present a computational approach to interpreting stereotypes in text through the Stereotype Content Model (SCM), a comprehensive causal theory from social psychology. The SCM proposes that stereotypes can be understood along two primary dimensions: warmth and competence. We present a method for defining warmth and competence axes in semantic embedding space, and show that the four quadrants defined by this subspace accurately represent the warmth and competence concepts, according to annotated lexicons. We then apply our computational SCM model to textual stereotype data and show that it compares favourably with survey-based studies in the psychological literature. Furthermore, we explore various strategies to counter stereotypical beliefs with anti-stereotypes. It is known that countering stereotypes with anti-stereotypical examples is one of the most effective ways to reduce biased thinking, yet the problem of generating anti-stereotypes has not been previously studied. Thus, a better understanding of how to generate realistic and effective anti-stereotypes can contribute to addressing pressing societal concerns of stereotyping, prejudice, and discrimination.


title: Model-agnostic and Scalable Counterfactual Explanations via Reinforcement Learning

abstract: Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous approaches require a separate, computationally expensive optimization procedure per instance, making them impractical for both large amounts of data and high-dimensional data. Moreover, these methods are often restricted to certain subclasses of machine learning models (e.g. differentiable or tree-based models). In this work, we propose a deep reinforcement learning approach that transforms the optimization procedure into an end-to-end learnable process, allowing us to generate batches of counterfactual instances in a single forward pass. Our experiments on real-world data show that our method i) is model-agnostic (does not assume differentiability), relying only on feedback from model predictions; ii) allows for generating target-conditional counterfactual instances; iii) allows for flexible feature range constraints for numerical and categorical attributes, including the immutability of protected features (e.g. gender, race); iv) is easily extended to other data modalities such as images.


title: Pose and Semantic Map Based Probabilistic Forecast of Vulnerable Road Users' Trajectories

abstract: In this article, an approach for probabilistic trajectory forecasting of vulnerable road users (VRUs) is presented, which considers past movements and the surrounding scene. Past movements are represented by 3D poses reflecting the posture and movements of individual body parts. The surrounding scene is modeled in the form of semantic maps showing, e.g., the course of streets, sidewalks, and the occurrence of obstacles. The forecasts are generated in grids discretizing the space and in the form of arbitrary discrete probability distributions. The distributions are evaluated in terms of their reliability, sharpness, and positional accuracy. We compare our method with an approach that provides forecasts in the form of Gaussian distributions and discuss the respective advantages and disadvantages. Thereby, we investigate the impact of using poses and semantic maps. With a technique called spatial label smoothing, our approach achieves reliable forecasts. Overall, the poses have a positive impact on the forecasts. The semantic maps offer the opportunity to adapt the probability distributions to the individual situation, although at the considered forecasted time horizon of 2.52 s they play a minor role compared to the past movements of the VRU. Our method is evaluated on a dataset recorded in inner-city traffic using a research vehicle. The dataset is made publicly available.


title: SOUP-GAN: Super-Resolution MRI Using Generative Adversarial Networks

abstract: There is a growing demand for high-resolution (HR) medical images in both the clinical and research applications. Image quality is inevitably traded off with the acquisition time for better patient comfort, lower examination costs, dose, and fewer motion-induced artifacts. For many image-based tasks, increasing the apparent resolution in the perpendicular plane to produce multi-planar reformats or 3D images is commonly used. Single image super-resolution (SR) is a promising technique to provide HR images based on unsupervised learning to increase resolution of a 2D image, but there are few reports on 3D SR. Further, perceptual loss is proposed in the literature to better capture the textual details and edges than using pixel-wise loss functions, by comparing the semantic distances in the high-dimensional feature space of a pre-trained 2D network (e.g., VGG). However, it is not clear how one should generalize it to 3D medical images, and the attendant implications are still unclear. In this paper, we propose a framework called SOUP-GAN: Super-resolution Optimized Using Perceptual-tuned Generative Adversarial Network (GAN), in order to produce thinner slice (e.g., high resolution in the 'Z' plane) medical images with anti-aliasing and deblurring. The proposed method outperforms other conventional resolution-enhancement methods and previous SR work on medical images upon both qualitative and quantitative comparisons. Specifically, we examine the model in terms of its generalization for various SR ratios and imaging modalities. By addressing those limitations, our model shows promise as a novel 3D SR interpolation technique, providing potential applications in both clinical and research settings.


title: Causal Graph Discovery from Self and Mutually Exciting Time Series

abstract: We present a generalized linear structural causal model, coupled with a novel data-adaptive linear regularization, to recover causal directed acyclic graphs (DAGs) from time series. By leveraging a recently developed stochastic monotone Variational Inequality (VI) formulation, we cast the causal discovery problem as a general convex optimization. Furthermore, we develop a non-asymptotic recovery guarantee and quantifiable uncertainty by solving a linear program to establish confidence intervals for a wide range of non-linear monotone link functions. We validate our theoretical results and show the competitive performance of our method via extensive numerical experiments. Most importantly, we demonstrate the effectiveness of our approach in recovering highly interpretable causal DAGs over Sepsis Associated Derangements (SADs) while achieving comparable prediction performance to powerful ``black-box'' models such as XGBoost. Thus, the future adoption of our proposed method to conduct continuous surveillance of high-risk patients by clinicians is much more likely.


title: Learning Hard Optimization Problems: A Data Generation Perspective

abstract: Optimization problems are ubiquitous in our societies and are present in almost every segment of the economy. Most of these optimization problems are NP-hard and computationally demanding, often requiring approximate solutions for large-scale instances. Machine learning frameworks that learn to approximate solutions to such hard optimization problems are a potentially promising avenue to address these difficulties, particularly when many closely related problem instances must be solved repeatedly. Supervised learning frameworks can train a model using the outputs of pre-solved instances. However, when the outputs are themselves approximations, when the optimization problem has symmetric solutions, and/or when the solver uses randomization, solutions to closely related instances may exhibit large differences and the learning task can become inherently more difficult. This paper demonstrates this critical challenge, connects the volatility of the training data to the ability of a model to approximate it, and proposes a method for producing (exact or approximate) solutions to optimization problems that are more amenable to supervised learning tasks. The effectiveness of the method is tested on hard non-linear nonconvex and discrete combinatorial problems.


title: InDiD: Instant Disorder Detection via Representation Learning

abstract: For sequential data, a change point is a moment of abrupt regime switch in data streams. Such changes appear in different scenarios, including simpler data from sensors and more challenging video surveillance data. We need to detect disorders as fast as possible. Classic approaches for change point detection (CPD) might underperform for semi-structured sequential data because they cannot process its structure without a proper representation. We propose a principled loss function that balances change detection delay and time to a false alarm. It approximates classic rigorous solutions but is differentiable and allows representation learning for deep models. We consider synthetic sequences, real-world data sensors and videos with change points. We carefully labelled available data with change point moments for video data and released it for the first time. Experiments suggest that complex data require meaningful representations tailored for the specificity of the CPD task -- and our approach provides them outperforming considered baselines. For example, for explosion detection in video, the F1 score for our method is $0.53$ compared to baseline scores of $0.31$ and $0.35$.


title: Study on the effects of the restrictive measures for containment of the COVID-19 pandemic on the reproduction number $R_t$ in Italian regions

abstract: Since November 6$^{\mathrm{th}}$, 2020, Italian regions have been classified according to four levels, corresponding to specific risk scenarios, for which specific restrictive measures have been foreseen. By analyzing the time evolution of the reproduction number $R_t$, we estimate how much different restrictive measures affect $R_t$, and we quantify the combined effect of the diffusion of virus variants and the beginning of the vaccination campaign upon the $R_t$ trend. We also compute the time delay between implementation of restrictive measures and the resulting effects. Three different models to describe the effects of restrictive measures are discussed and the results are cross-checked with two different algorithms for the computation of $R_t$.


title: Do Persuasive Designs Make Smartphones More Addictive? -- A Mixed-Methods Study on Chinese University Students

abstract: Persuasive designs become prevalent on smartphones, and an increasing number of users report having problematic smartphone use behaviours. Persuasive designs in smartphones might be accountable for the development and reinforcement of such problematic use. This paper uses a mixed-methods approach to study the relationship between persuasive designs and problematic smartphone use: (1) questionnaires (N=183) to investigate the proportion of participants having multiple problematic smartphone use behaviours and smartphone designs and applications (apps) that they perceived affecting their attitudes and behaviours, and (2) interviews (N=10) to deepen our understanding of users' observations and evaluations of persuasive designs. 25\% of the participants self-reported having multiple problematic smartphone use behaviours, with short video, social networking, game and learning apps perceived as most attitude and behaviour-affecting. Interviewees identified multiple persuasive designs in most of these apps and stated that persuasive designs prolonged their screen time, reinforced phone-checking habits, and caused distractions. Overall, this study provides evidence to argue that persuasive designs contribute to problematic smartphone use, potentially making smartphones more addictive. We end our study by discussing the ethical implications of persuasive designs that became salient in our study.